-- Logs begin at Thu 2022-07-21 22:45:53 UTC, end at Thu 2022-07-21 23:54:34 UTC. -- Jul 21 23:24:10.518193 dv-cinder-850700-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 23:24:10.529342 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 23:24:10 2022] *** Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: nodename: dv-cinder-850700-1-iscsi Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: machine: x86_64 Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: clock source: unix Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: pcre jit disabled Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: detected number of CPU cores: 4 Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: current working directory: / Jul 21 23:24:10.529867 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: detected binary path: /usr/bin/uwsgi-core Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: your processes number limit is 47680 Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: your memory page size is 4096 bytes Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: detected max file descriptor number: 2048 Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: lock engine: pthread robust mutexes Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: thunder lock: enabled Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 23:24:10.530345 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 23:24:10.578557 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: Python main interpreter initialized at 0x55fc0484b9c0 Jul 21 23:24:10.578557 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: python threads support enabled Jul 21 23:24:10.578557 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: your server socket listen backlog is limited to 100 connections Jul 21 23:24:10.578557 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: your mercy for graceful operations on workers is 90 seconds Jul 21 23:24:10.578917 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 23:24:10.578986 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: *** Operational MODE: preforking *** Jul 21 23:24:10.579244 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: *** uWSGI is running in multiple interpreter mode *** Jul 21 23:24:10.579244 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: spawned uWSGI master process (pid: 80228) Jul 21 23:24:10.579447 dv-cinder-850700-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 21 23:24:10.581000 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: spawned uWSGI worker 1 (pid: 80238, cores: 1) Jul 21 23:24:10.581000 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: spawned uWSGI worker 2 (pid: 80239, cores: 1) Jul 21 23:24:10.581000 dv-cinder-850700-1-iscsi devstack@keystone.service[80228]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 23:24:16.027648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:24:16.027648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: from cryptography.utils import int_from_bytes Jul 21 23:24:16.028456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:24:16.028456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: from cryptography.utils import int_from_bytes Jul 21 23:24:16.028980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:24:16.028980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: from cryptography.utils import int_from_bytes Jul 21 23:24:16.029478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 23:24:16.029478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: from cryptography.utils import int_from_bytes Jul 21 23:24:16.077412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:24:16.077611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:24:16.077829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] command line args: [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:24:16.078111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:24:16.078310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ================================================================================ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:24:16.078394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 23:24:16.078580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] admin_token = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.078666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 23:24:16.078803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] command line args: [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 23:24:16.078887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_dir = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 23:24:16.079246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] config_source = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ================================================================================ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 23:24:16.079427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] debug = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] admin_token = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.079882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] config_dir = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] config_source = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] debug = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.080950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_config_append = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_dir = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.081912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_config_append = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_dir = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.082945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.083080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.083184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.083280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.083391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.083391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.084922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.085949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] publish_errors = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.086968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] publish_errors = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] standard_threads = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.087984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_journal = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_json = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_stderr = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.088985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] use_syslog = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] standard_threads = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.089664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.089748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.089841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] use_journal = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.090023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.090170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] use_json = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.090249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.090309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] use_stderr = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.090472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.090552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] use_syslog = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.090676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.090753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 23:24:16.090913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.091959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.092906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.093894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.094989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.095931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.096965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.097939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.098881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.099018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.099122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.099812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.099934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.100956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.101975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.102712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.103549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.103663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.103744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.103861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.103935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.104919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.105996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.106922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.107896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.108922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.109998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.110896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.111822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.112799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.113971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.external = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.114845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.password = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] auth.token = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.115982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.external = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.116973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.password = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] auth.token = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.117945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.118968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.119942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.120928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.121913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.122879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.123890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.124965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.125952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.126932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.127848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.128976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.129940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.130984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.131937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.132965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.133945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.134879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.135978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.136997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.137968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.138941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.139876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.140979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.141938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.142971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.143915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.144865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.145829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.146490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.146580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.146749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.146830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.147961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.148984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.149984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] role.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] role.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.150931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.151904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.152960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.153955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.154968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.155943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.156904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.157873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.158981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.159997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.160943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.161110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.161218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.161370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.161450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.161624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.162959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.163892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.164848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.165976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:24:16.166443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.166928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.167167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.167417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.167649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.167892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.168127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 23:24:16.168299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 23:24:16.197810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.198036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.198265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.199009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.199243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.199471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.206641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.207867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.235332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.235561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.236785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.237019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.378678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.379112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.429544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.429680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.429769 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.429848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.494926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.495988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.496080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.496206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.496404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.521511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.521796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.521906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522244 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.522890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.523032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.523249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.533998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.534267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.547317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.547552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.547735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.547822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.547968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80239) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.548815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.549029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80238) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 23:24:16.566225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.566435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 23:24:16.566667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.566763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.566879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 23:24:16.566960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 23:24:16.567212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.567293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.567413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 23:24:16.567493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.567682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.567764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.567969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.568050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.568230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.568588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.579049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.579326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.579594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.579751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.579876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.580030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.580299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.580577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.588637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.589449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.591951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.592231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.592510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.592749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.592901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.593818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.594882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.595079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.595354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.595624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.622240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.623037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.623850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.624130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.624661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.624946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.629475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.629708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.629986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.630279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.630745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.631048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.637349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.637632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.638645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.638935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.642517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.642802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.643077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.643353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.643582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.643665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.643872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.643954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.644959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.645250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.645518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.664415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.664695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.665449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.665728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.669409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.670331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.673024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.673341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.674008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.674303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.678489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.682136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.683200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.685922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.686221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.686517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.686800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.687896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.688177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.688460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.706545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.706920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.707194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.707458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.707810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.708189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.708461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.709349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.716123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.717331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.717858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.718131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.719047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.719326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.721273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.721554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.721834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.722112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.722386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.722475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.722696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.722973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.723263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.723538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.735861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.736141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.736419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.736695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.736972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.737107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.737288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.737413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.737565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.737694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.737974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.738255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.738546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.738823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.757494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.758744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.760777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.762088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.764364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.765731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.766003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.767335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.767633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.767910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.768201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.768990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.769301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.769587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.776320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.777699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.777956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.779348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.781210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.781510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.781790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.782063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.782605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.782897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.783182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.783458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.791874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.792159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.792437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.793346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.793637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.793917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.800348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80239) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.800630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.800910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.801197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.801486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.801765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.801882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80238) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 23:24:16.802039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.802162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.802443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.802928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.803989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80239) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.804077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.804302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.804571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.804831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.805105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.805401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80238) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 23:24:16.842571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc0484b9c0 pid: 80239 (default app) Jul 21 23:24:16.844153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc0484b9c0 pid: 80238 (default app) Jul 21 23:24:16.845883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec845-030b-4cf3-8a3e-7f613d5b5ccc None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:16.846175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec845-030b-4cf3-8a3e-7f613d5b5ccc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:16.846454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec845-030b-4cf3-8a3e-7f613d5b5ccc None None] PATH_INFO: `/v3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:16.851342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Thu Jul 21 23:24:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:24.460998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:24.461558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:24.461558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:24.465860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:24.471226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:24.471615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:24.471785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:24.549698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: INFO dbcounter [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] Registered counter for database keystone Jul 21 23:24:24.571143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG oslo_db.sqlalchemy.engines [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:24:24.577384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writer thread running {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:24:24.752833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG passlib.handlers.bcrypt [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80239) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 23:24:24.753403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG passlib.handlers.bcrypt [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80239) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 23:24:24.810102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:24.811743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:24.933951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 23:24:25.111099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:25.181688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: INFO dbcounter [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] Registered counter for database keystone Jul 21 23:24:25.201121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG oslo_db.sqlalchemy.engines [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 23:24:25.207240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writer thread running {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 23:24:25.325157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcdbf-cdcd-4041-aa4f-8f6374a55031 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:25.329769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:25.330825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:25.331279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:25.331727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:25.340992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:25.393106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING keystone.common.rbac_enforcer.enforcer [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 23:24:25.393404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c4aad-1842-4389-97fe-d94db41daefa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:25.403681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Jul 21 23:24:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 23:24:25.409773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:25.425547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27703d-0a98-48ee-a7f5-52a78064193c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:25.429954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:25.431066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:25.431355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:25.431632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] PATH_INFO: `/v3/projects/853ebd43a36d473dbecd2e6330bf3136` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:25.435753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] RBAC: Authorizing `identity:get_project(project_id=853ebd43a36d473dbecd2e6330bf3136)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:25.488207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING keystone.common.rbac_enforcer.enforcer [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 23:24:25.488757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18125f1b-2a4e-4704-b045-54a4230f4125 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:25.493371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Thu Jul 21 23:24:25 2022] GET /identity/v3/projects/853ebd43a36d473dbecd2e6330bf3136 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:27.512160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbe35-7e42-4298-a449-bcf5b8d49049 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:27.512669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbe35-7e42-4298-a449-bcf5b8d49049 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:27.512757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bbe35-7e42-4298-a449-bcf5b8d49049 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:27.517167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:27.522939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:27.523353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:27.523501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:27.542503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:27.544001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:27.551796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 23:24:27.573882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bbe35-7e42-4298-a449-bcf5b8d49049 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:27.585924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bbe35-7e42-4298-a449-bcf5b8d49049 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:27.590184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:27.590817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:27.591107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:27.591386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:27.599852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:27.601771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb22351-d9d8-469c-8b0c-33a6ba98c1c8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:27.610631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Jul 21 23:24:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:24:27.616640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:27.625550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd2750-256a-46c6-89c6-79f1245d3eb7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:27.629869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:27.631062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:27.631339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:27.631615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:27.632998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:27.634838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca927c-a6cb-4748-b72e-bfd35cb8b4ea admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:27.636404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Thu Jul 21 23:24:27 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:29.720906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be1fb-f96d-4a3f-89f5-8b9095ca6145 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:29.721471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be1fb-f96d-4a3f-89f5-8b9095ca6145 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:29.721471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4be1fb-f96d-4a3f-89f5-8b9095ca6145 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:29.722858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:29.728034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:29.728433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:29.728597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:29.737522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade0d4-8e47-44e0-88f5-03d0e7a15227 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:29.737812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade0d4-8e47-44e0-88f5-03d0e7a15227 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:29.738091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade0d4-8e47-44e0-88f5-03d0e7a15227 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:29.739501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:29.744268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:29.744555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:29.744834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:29.745388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:29.746607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:29.784775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG passlib.handlers.bcrypt [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80238) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 23:24:29.785267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG passlib.handlers.bcrypt [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80238) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 23:24:29.829374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:29.830693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:29.832314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:29.852053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:29.875395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:29.933539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:29.956626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:29.958032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb4388-15e2-489b-a5fa-a2030f16ebf7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:29.992239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:29.992894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:29.993204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:29.993488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.056069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30ebf-9444-45a9-a11f-a5530aff0236 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.058372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.059512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.060995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.084653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.094702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.095751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.096038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.096315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.108115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:30.119995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:30.120922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:30.121764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 8/14] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:24:30.126945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.163151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 7/15] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 23:24:30.169091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.225445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14d41d-a7fb-44ec-88ea-61e2246203a8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.258583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.259180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.259457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.259731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.260478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:30.260781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.262238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.266588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87e82b-47fa-4c80-8465-22bb28edef6a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.274189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 9/16] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:30.279862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.288946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.300705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.301535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.301815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.302822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.306301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.313755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.315217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:24:30.337017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:30.337894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:30.338688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:24:30.338688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:24:30.338688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:24:30.338688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:30.338688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 8/17] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:24:30.343833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.378377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358219d-ea46-4195-817b-f2d44b489988 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.412851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.413761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.414050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.414331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.415901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.417409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.419053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:30.424378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.445069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b6df1-d99b-493e-a864-7bc93842e00d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.480778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.481469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.481756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.482033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.482758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:30.483062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.484457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.502067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:30.520566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.528605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44896d-15f4-40a5-809c-f5104f065f94 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.566068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.566893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.567182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.567511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.568741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.570267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828f96-d5e9-4607-bbc0-c1e47d8acdeb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.571975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:30.578068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:30.614222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:30.687173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378eb0b9-e995-4d6a-8791-ee030c46c180 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:30.723350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:30.724056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:30.724335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:30.724607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:30.725499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.domain.id=default, user.id=055fbabca2a64bd6aab2d3bd73469ee6) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:30.725813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:30.727256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e2763-05d2-4633-956e-a583c61f60f3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:30.735206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Jul 21 23:24:30 2022] GET /identity/v3/role_assignments?user.id=055fbabca2a64bd6aab2d3bd73469ee6&scope.domain.id=default&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:33.017139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbaad-35aa-48ba-8947-284c871e4ff6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.018193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbaad-35aa-48ba-8947-284c871e4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.018671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bbaad-35aa-48ba-8947-284c871e4ff6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.020261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:33.025676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.026623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.027108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.050443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:33.053353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:33.135109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9b1d-2e59-4e7a-b1e1-f4d9710098b3 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.135883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9b1d-2e59-4e7a-b1e1-f4d9710098b3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.136358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe9b1d-2e59-4e7a-b1e1-f4d9710098b3 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.137981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 13/23] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:33.144119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.144638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.145247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.146777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:33.163346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:33.164872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:33.184690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:33.233763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:33.242984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:33.267762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:33.346831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bcf25-ce60-4f4c-8e6c-06a8069835d9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:33.369616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:33.374160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5d975-fff5-45ec-8e90-1dbbcbb12fe2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:33.396969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:33.397695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.397979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.398254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.399007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:33.400402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd7d6-fd5b-4123-ae71-a02281a57262 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:33.449945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:33.450756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.451046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.451329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.475419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:33.476930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d3613c27-bc9c-422d-b812-9d28a0c92166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:24:33.516360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:33.517276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:33.518106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:24:33.518106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:24:33.518106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:24:33.518106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:33.526103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 15/26] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:24:33.527486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa778a3-d7de-4110-8ada-6616bdb6d1d2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.527781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa778a3-d7de-4110-8ada-6616bdb6d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.528067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa778a3-d7de-4110-8ada-6616bdb6d1d2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.529610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 16/27] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:33.531764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa778a3-d7de-4110-8ada-6616bdb6d1d2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:33.558741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 12/28] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:24:33.560523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.560822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.561107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.598112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:33.601286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:33.711388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa778a3-d7de-4110-8ada-6616bdb6d1d2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:33.742434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 13/29] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:33.765368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:33.766104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.766394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.766673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.767412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:33.767721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:33.769216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3231a-9875-4729-be6e-69fffe0b3b5e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:33.783286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:33.804413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 17/30] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:33.805865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0041-b49c-434b-ae91-ccff935a5204 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.806164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0041-b49c-434b-ae91-ccff935a5204 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.806447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b0041-b49c-434b-ae91-ccff935a5204 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.808028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 18/31] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:33.813699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:33.814153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b0041-b49c-434b-ae91-ccff935a5204 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:33.824475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:33.941744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354161-8bdb-46de-ad19-622ae21b198f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:33.967689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b0041-b49c-434b-ae91-ccff935a5204 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:33.993685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:33.994946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:33.995784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:33.996246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:33.997279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:33.999606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4b5b9-009d-4f4f-9871-c91a5e792f97 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.021989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 14/32] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/roles => generated 225 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:24:34.023215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.023512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.023797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.027893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.028631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.028885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.029209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.029959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:34.031679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4192c7e-6e7a-4954-a5a5-48b182d98907 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.055335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:34.058113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:34.214905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 15/33] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:34.227589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 19/34] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:24:33 2022] POST /identity/v3/projects => generated 301 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:34.251025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:34.262629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:34.317978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689cc7-78c7-40ed-ae72-a68e73693673 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.318192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689cc7-78c7-40ed-ae72-a68e73693673 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.318657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689cc7-78c7-40ed-ae72-a68e73693673 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.322148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 20/35] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:34.327328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.327328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.327328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.351089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:34.353174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:34.394601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ad32a-4a93-4be1-84db-af181cffeb17 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:34.434108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:34.436521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.437379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.437674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.437956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.451993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:34.460908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:34.461933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:34.462720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 16/36] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:34.465981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 21/37] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:34.472096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:34.493746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:34.543603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:34.582137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91aeef-c5b3-4444-acce-f21c331323be None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:34.605411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f8b6d-36a6-4897-a130-9129d0155da8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:34.619089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.619878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.620164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.620444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.621221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:34.621527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:34.623178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.636048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 17/38] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:34.639810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.640495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.640899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.641134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.641784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:34.641947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:34.643465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.669230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 22/39] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 23:24:34 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:24:34.761927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04d66-994d-45a9-91df-492fcafb8ef3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:34.795382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:34.802711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.803521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.803809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.804087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.805422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:34.806908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df50bf-908f-4784-81cb-915763c2a88a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.808796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 18/40] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:34 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:34.814231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:34.824920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc5a2-416b-44ed-acbf-15f90f043347 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.824920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc5a2-416b-44ed-acbf-15f90f043347 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.824920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bc5a2-416b-44ed-acbf-15f90f043347 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.826415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 19/41] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:34.831743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.832068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.832411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.871537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:34.935578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d52d61-f6d9-4b75-ad91-bef6d26e8290 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:34.958270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:34.959650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:34.969783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:34.970582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:34.970874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:34.971153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:34.972331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:34.974393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:34.976036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 23/42] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:34.981546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:35.028296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 20/43] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:35.051643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:35.082734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4a8bd-82fe-4a0c-90bc-19f7571239fa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:35.101675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:35.128851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:35.130445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:35.130785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:35.131224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] PATH_INFO: `/v3/domains/default/users/055fbabca2a64bd6aab2d3bd73469ee6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:35.134456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=055fbabca2a64bd6aab2d3bd73469ee6, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:35.136958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:35.157279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 24/44] 10.222.0.57 () {58 vars in 1361 bytes} [Thu Jul 21 23:24:34 2022] PUT /identity/v3/domains/default/users/055fbabca2a64bd6aab2d3bd73469ee6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:24:35.176519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db70ebe-7037-4dba-9509-4ef64216232a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:35.219921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:35.233789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:35.234957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:35.235380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:35.235792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:35.237588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:35.240813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811d369-203b-402c-97b3-89b3f9519cc4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:35.243573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 21/45] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:35.249452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:35.359477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773341c-0c77-49bc-9d95-18a433268b50 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:35.392558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:35.393255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:35.393543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:35.393822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:35.394551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:35.396756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436986e-ef8d-4c23-9f12-954f6c6541b7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:35.421590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 25/46] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:24:35 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:24:37.237990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2ba0-9751-46c2-bf6a-b193cee7f19c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.238497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2ba0-9751-46c2-bf6a-b193cee7f19c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2ba0-9751-46c2-bf6a-b193cee7f19c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.241056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 22/47] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:37.246211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d6c7-f5f4-42a0-b650-c8a3ad256284 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.246580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d6c7-f5f4-42a0-b650-c8a3ad256284 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.246785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57d6c7-f5f4-42a0-b650-c8a3ad256284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.263821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2d57d6c7-f5f4-42a0-b650-c8a3ad256284 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:37.265039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2d57d6c7-f5f4-42a0-b650-c8a3ad256284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:37.284951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:37.332111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:37.355112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2ba0-9751-46c2-bf6a-b193cee7f19c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.454606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2ba0-9751-46c2-bf6a-b193cee7f19c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.454772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc6c7-9f00-4fb6-aec2-d0fcd6b973ed None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.455065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc6c7-9f00-4fb6-aec2-d0fcd6b973ed None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.455347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc6c7-9f00-4fb6-aec2-d0fcd6b973ed None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.456724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 27/49] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:37.461661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe978-6113-4952-be3e-465457b02440 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.461943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe978-6113-4952-be3e-465457b02440 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.462230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fe978-6113-4952-be3e-465457b02440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.479343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f00fe978-6113-4952-be3e-465457b02440 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:37.480539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f00fe978-6113-4952-be3e-465457b02440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:37.489011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.490386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.490671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.490948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.501092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:37.509440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:37.510441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:37.511174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 23/50] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:37.517634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.548928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 28/51] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:37.573371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fe978-6113-4952-be3e-465457b02440 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.577650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:37.622404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4819e8-f45f-43a0-88ee-50bbf2cceff4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.656109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:37.656873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.657577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.657862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.658141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.658892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:37.659198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:37.660576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:37.670234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 24/52] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:37.672781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fe978-6113-4952-be3e-465457b02440 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.676577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.709354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.710085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.710365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.710647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.711827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:37.713970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:37.714917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 29/53] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:37.720276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.783188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0340cfe-ea4c-413e-aa1b-5c60d350cfe4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.802524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:37.819603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.820493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.820778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.821060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.822314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:37.823812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:37.825511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 25/54] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:37.827844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12932daa-5114-47a7-89e8-0af0e6ed657c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.830783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:37.864382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.865053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.865370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.865646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.866360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:37.867814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:37.893790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 30/55] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Jul 21 23:24:37 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:24:37.944657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf86a55-ab8d-425c-b538-fe3c77382847 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:37.980932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:37.981689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:37.981980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:37.982261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:37.983609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:37.985152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e752c7-ae21-4391-81b7-5a922bf2c7ac None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:37.986871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 26/56] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:37.992882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:38.112740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:38.204170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f1666-68b2-44e7-af40-35e9453a0d75 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:38.237338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:38.237932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:38.238218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:38.238494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:38.239892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.domain.id=default, user.id=055fbabca2a64bd6aab2d3bd73469ee6) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:38.240202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:38.241689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e5b49-4a08-4a7d-9897-cf3aaf3320cb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:38.249857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 31/57] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Jul 21 23:24:37 2022] GET /identity/v3/role_assignments?user.id=055fbabca2a64bd6aab2d3bd73469ee6&scope.domain.id=default&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 530 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:39.961959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1534-c39d-4e83-864c-f126d13ee872 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:39.962501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1534-c39d-4e83-864c-f126d13ee872 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:39.962501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d1534-c39d-4e83-864c-f126d13ee872 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:39.963896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 27/58] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:39.968990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:39.969425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:39.969580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:39.986303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:39.987489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:40.047795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:40.052585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 32/59] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:40.076004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1534-c39d-4e83-864c-f126d13ee872 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:40.134359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:40.180398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d1534-c39d-4e83-864c-f126d13ee872 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:40.212060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:40.212790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:40.213077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:40.213387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:40.214554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:40.216004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c7509-a092-4621-86ac-9161d89e9a3a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:40.217646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 28/60] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:40.223126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:40.319893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee6bd-f264-44a8-ace1-c39f073fe73e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:40.352797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:40.353503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:40.353794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:40.354076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:40.354801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:40.356259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998abc2-4402-4421-b1b4-d8c5190aa990 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:40.381020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 33/61] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:24:40 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:43.524260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c1f1-cfb5-4e85-ab69-365626c8b326 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.525368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c1f1-cfb5-4e85-ab69-365626c8b326 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.525864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c1f1-cfb5-4e85-ab69-365626c8b326 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.527728 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 29/62] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:43.532965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3ad8-4a7d-4b27-a1f7-2c9b95a049b5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.533841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3ad8-4a7d-4b27-a1f7-2c9b95a049b5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.534341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3ad8-4a7d-4b27-a1f7-2c9b95a049b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.558246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2dbd3ad8-4a7d-4b27-a1f7-2c9b95a049b5 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:43.559793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2dbd3ad8-4a7d-4b27-a1f7-2c9b95a049b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:43.630121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:43.653838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 34/63] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:43.674807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef040-4aef-43ea-be9b-5a1cb0c37059 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.675400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef040-4aef-43ea-be9b-5a1cb0c37059 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.675874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ef040-4aef-43ea-be9b-5a1cb0c37059 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.678597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 30/64] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:43.684783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d0759-ab85-494b-8a3c-53f6ba7a1989 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.685371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d0759-ab85-494b-8a3c-53f6ba7a1989 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.685874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d0759-ab85-494b-8a3c-53f6ba7a1989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.692036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef040-4aef-43ea-be9b-5a1cb0c37059 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:43.721034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-800d0759-ab85-494b-8a3c-53f6ba7a1989 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:43.722294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-800d0759-ab85-494b-8a3c-53f6ba7a1989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:43.854525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 35/65] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:43.868657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ef040-4aef-43ea-be9b-5a1cb0c37059 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:43.873781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-2fa8-4f27-a3c8-f663cac43310 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.874311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-2fa8-4f27-a3c8-f663cac43310 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.874788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316546b2-2fa8-4f27-a3c8-f663cac43310 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.877142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 36/66] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:43.883228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.883922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.884507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.900322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:43.911025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:43.912755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:43.914528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:43.915625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:43.915913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:43.916189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:43.930457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:43.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:43.941546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:43.942828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 31/67] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:43.943944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.001217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 37/68] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:44.002535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.062370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.064421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68685-935a-4dba-a7cb-cf8a94adcaf7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.103277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.104074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.104360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.104707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.116982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:44.117157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52de748-1b23-47c1-a82f-15c5f162f82b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-71a1d32e-9922-40df-a56c-215dbd6d5507 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:44.124761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:44.125657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:44.126635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 32/69] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:44.127641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea22b-13a6-4480-8fc6-bf97d7fef082 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.127884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea22b-13a6-4480-8fc6-bf97d7fef082 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.128162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea22b-13a6-4480-8fc6-bf97d7fef082 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.129455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 33/70] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:44.130754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea22b-13a6-4480-8fc6-bf97d7fef082 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.157401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.158076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.158363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.158643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.159398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:44.159704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.161134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce901383-b8df-412d-8728-d1b518fcf705 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.170185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 38/71] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.171414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a5017-5e7b-4122-9dcf-da9d0b790cda None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.172124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a5017-5e7b-4122-9dcf-da9d0b790cda None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.172415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a5017-5e7b-4122-9dcf-da9d0b790cda None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.179083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 39/72] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:44.179083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a5017-5e7b-4122-9dcf-da9d0b790cda None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.179288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.235235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea22b-13a6-4480-8fc6-bf97d7fef082 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.269510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.270986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.271268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.271544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.278848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a5017-5e7b-4122-9dcf-da9d0b790cda None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.281515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:44.287771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2bdef6aa-0727-4469-88f7-1efee062af16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:44.289749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:44.290581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:44.291321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 34/73] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:44.292130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d091-bc9e-4f28-8c90-7b10dce39c5b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.292416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d091-bc9e-4f28-8c90-7b10dce39c5b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.292700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6d091-bc9e-4f28-8c90-7b10dce39c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.309396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e8e6d091-bc9e-4f28-8c90-7b10dce39c5b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:44.310591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e8e6d091-bc9e-4f28-8c90-7b10dce39c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:44.317605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.318229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.318518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.318804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.319559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:44.319869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.321277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.329739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 40/74] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.330584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.377329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 35/75] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:44.378815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.379106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.379386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.399998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:44.401279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:44.428164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.439997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce097d-4fba-4a58-864d-87d14a0a2323 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.469508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 36/76] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:44.470411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.474435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.475320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.475605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.475881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.491099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.492653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.494419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 41/77] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.495260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.526305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.577558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3759-ca92-4b15-8bf8-1b013707999f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.596947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966befe-2e07-4fb6-9924-b4258672fdb7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.611929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.612601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.612893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.613170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.614478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:44.614786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.616174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.624224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 37/78] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.624766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.635561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.636388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.636666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.636941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.638433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.639887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.641563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 42/79] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.642324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.654328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.729271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9e170-4e5b-4b85-b8e6-bdd1ef85875d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.734980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.741402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe7921-4ab7-480a-bb17-1b076652455a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.762574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.763623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.763911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.764193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.765399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.766838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.768460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 38/80] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.768460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.776376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.777172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.777482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.777760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.787708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:44.795402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:44.796413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:44.797213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 43/81] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:44.797855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.865684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.875151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf15d1-abcf-44c5-bf9f-0688246e03b1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.900777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a78-1a3f-44fa-b7b3-292201d028bd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:44.912378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.913036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.913355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.913635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.934802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:44.935717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:44.936003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:44.936283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:44.937516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.938990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:44.940633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 44/82] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:44.941430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:44.967739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:44.981691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:44.983169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.042485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffa999-92a7-45db-af28-8edd623f46d3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.070853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.075845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.076580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.076937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.077324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.080653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 39/83] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:45.086146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.147087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.148561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.172726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.187162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144bd1d-dda9-4fe0-9377-aa351f066a01 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.220783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.221480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.221771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.222057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.222776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.224896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.247682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 45/84] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:45.248535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.251303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 40/85] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:24:45 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:45.251966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.308680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.368033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5f867-cd9e-44cb-844b-b7fbce65d99a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.368241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab24a2-5978-441e-8d91-5dc8c8eb631e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.394679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.408376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.409042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.409365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.409642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.411823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.412510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.412800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.413081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.413894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:45.414202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.416156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.425336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 46/86] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.426096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.500812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.502667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.561035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.561848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd50ba-2f89-4bac-9d8a-726a231eaa52 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.607197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.608344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.608633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.609072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.610851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.612836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.615478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 47/87] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.616405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.623645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 41/88] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:45.624380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.687415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.741232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c0a14-783f-4540-93fa-2eee543b30cb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.744455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3d6a9-13a6-4873-8228-86e053f91fa2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.777846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.778724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.779012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.779290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.780499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.782111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.783899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 48/89] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.784669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.785319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.786941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.787410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.787953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.789535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.791526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.793422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 42/90] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.794498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.815417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.896275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e9bf-801c-4787-8b74-6d5a3d1919e4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.918070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b16c8-9b75-4d89-b419-21143a608f53 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:45.921738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:45.936299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.937275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.937632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.937860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.938715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:45.939032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.941035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.951206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 49/91] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=7df455d940c54f13b78a737b9c240982 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.952282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:45.981536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:45.982468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:45.982773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:45.983040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:45.987441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:45.989668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:45.991684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 43/92] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:45.992475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:46.070892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f36c-b3e3-4750-9fbf-522059a2302e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:46.118373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:46.119415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:46.119902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:46.120657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:46.122617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=055fbabca2a64bd6aab2d3bd73469ee6) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:46.123373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:46.125955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:46.139761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 50/93] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/role_assignments?user.id=055fbabca2a64bd6aab2d3bd73469ee6&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:46.142229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:46.203364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:46.228105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:46.261127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34e9aa-7df4-47e6-904f-e6221a763335 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:46.261756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda883f1-0f25-47f0-8bc7-a434c5970acd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:46.299744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:46.300766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:46.301483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:46.302218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:46.303387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:46.303921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:46.305660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:46.312267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 51/94] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:46 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:46.323855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:46.324891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:46.325423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:46.325908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:46.415138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:46.417018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:46.511355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:46.531121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 44/95] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:46.537574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:46.664221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035ed7a-e013-452a-a0bb-d910b1133a3b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:46.684701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:46.710410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:46.711621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:46.712152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:46.712628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] PATH_INFO: `/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:46.714075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=d90b75f57c6649c4bce6a0fd90e56e6c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:46.715739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ba582-b552-468d-8847-4d61000eb0a5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:46.717702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 52/96] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:46 2022] GET /identity/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:46.723786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:46.857032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b50515-aa0b-44e8-a75f-9b4dc2b9318a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:46.909893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:46.911511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:46.912152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:46.912630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:46.913726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=d90b75f57c6649c4bce6a0fd90e56e6c, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:46.914247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:46.915902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b37db-41ad-40ba-88f1-42b82d3f89b2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:46.922077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 45/97] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:46 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=d90b75f57c6649c4bce6a0fd90e56e6c&role.id=7df455d940c54f13b78a737b9c240982 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:47.959395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998be33-4777-4c68-8d5a-11f96bc79874 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:47.960407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998be33-4777-4c68-8d5a-11f96bc79874 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:47.960895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998be33-4777-4c68-8d5a-11f96bc79874 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:47.962777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 53/98] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:47.968581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0288-79bc-4773-af61-bc1e451ec883 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:47.969424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0288-79bc-4773-af61-bc1e451ec883 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:47.970010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c0288-79bc-4773-af61-bc1e451ec883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:47.991621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7c6c0288-79bc-4773-af61-bc1e451ec883 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:47.993160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7c6c0288-79bc-4773-af61-bc1e451ec883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:48.055400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:48.087608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 46/99] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:48.121094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998be33-4777-4c68-8d5a-11f96bc79874 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:48.230838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf99f0-f473-4179-bf70-58ecefec0e60 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.231465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf99f0-f473-4179-bf70-58ecefec0e60 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.232066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf99f0-f473-4179-bf70-58ecefec0e60 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.233969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 47/100] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:48.240390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.240948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.241446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.262386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998be33-4777-4c68-8d5a-11f96bc79874 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:48.282223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:48.283789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:48.331252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:48.332163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.332462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.332850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.358163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:48.368312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:48.369217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:48.369985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 54/101] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:48.378159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:48.427149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 48/102] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:48.462552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:48.477655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:48.555373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15732-d82a-4efe-b0ed-ac2940344ae5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:48.615923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:48.616603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.616888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.617166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.617943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:48.618252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:48.622656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161fd7-102f-40b8-afda-e65d28cc58f9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:48.638561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 55/103] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:48.640771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2f5c-6abd-47d5-981c-947d8404188a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.641062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2f5c-6abd-47d5-981c-947d8404188a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.641368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd2f5c-6abd-47d5-981c-947d8404188a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.642744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 56/104] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:48.649375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2c836-e750-4b8b-b49e-f0c3f68ce2f0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:48.651532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd2f5c-6abd-47d5-981c-947d8404188a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:48.667440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:48.696992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:48.697837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.698181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.698463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.699869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:48.701428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fc783-1c13-4738-acfd-54a8c1825501 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:48.703525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 49/105] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:48.704762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.705053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.705360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.723856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:48.725322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:48.842914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd2f5c-6abd-47d5-981c-947d8404188a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:48.846350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 50/106] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:48.854250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:48.855910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:48.928967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:48.929983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:48.930273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:48.930549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] PATH_INFO: `/v3/users/c06794f152af429aaea22eb44ce4ef7f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:48.956500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] RBAC: Authorizing `identity:get_user(user_id=c06794f152af429aaea22eb44ce4ef7f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:48.961437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:48.965419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 57/107] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:48 2022] GET /identity/v3/users/c06794f152af429aaea22eb44ce4ef7f => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:48.968803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.021281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d89e6-e6a2-42bc-bdbb-5b40f4975d1c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.029282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.067041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.067774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.068167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.068450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.069297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:49.070864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:49.116148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f0af-b2d1-4252-a6db-5af6e19a6a36 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.129404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 51/108] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:24:48 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:49.130290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.173084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.173933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.174223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.174557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.192799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:49.206937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:49.207937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:49.208770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 58/109] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:49.215810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.251295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2d521-b101-4311-ba7a-02447e83d3b1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.259620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.297097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.298110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.298719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.300592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.367694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.429275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce343c6f-4214-4246-8e13-53f5ebe6ec39 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.446746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:49.448465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2999cfe7-519a-4ed2-ad4a-22d90b03d12e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:49.480128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.480958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.481392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.481788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.482713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:49.483121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:49.484700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dd7f-9789-42ad-8e25-e91f61c4931d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:49.495769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 59/110] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:49.497396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad894-c808-4970-a8b0-5cd5353a791d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.502373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad894-c808-4970-a8b0-5cd5353a791d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.502769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad894-c808-4970-a8b0-5cd5353a791d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.504629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 60/111] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:49.505605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad894-c808-4970-a8b0-5cd5353a791d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.567313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 52/112] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:49.568973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.569339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.569629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.589981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:49.591181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:49.626629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.647301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad894-c808-4970-a8b0-5cd5353a791d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.652258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.667719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 53/113] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:49.668584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.688699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.690122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.690474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.690819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.692814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:49.694605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5d6d-bb32-44a5-9435-b4f6ca0fe822 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:49.696452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 61/114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:49.698035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a1ab-45ea-496e-8a18-8fd988047fde None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.698414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a1ab-45ea-496e-8a18-8fd988047fde None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.698767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70a1ab-45ea-496e-8a18-8fd988047fde None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.700088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 62/115] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:49.700900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70a1ab-45ea-496e-8a18-8fd988047fde None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.805920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0cc94-19e8-4e36-9d1e-a7e762d24675 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.822355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70a1ab-45ea-496e-8a18-8fd988047fde None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:49.846323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.847192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.847475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.847751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.849819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:49.851288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:49.853328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 54/116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:49.854263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:49.867747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:49.869141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.870164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.870700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.886289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6868a164-c886-4319-a5ec-1b0220a7ac11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:49.898437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:49.899307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:49.900043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:49.902853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 63/117] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:49.904289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:49.904706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:49.905106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:49.927168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.928585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:49.930175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:49.938766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:49.975873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a545d-c294-4938-8bb8-84c4ad33e8c3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.003957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 64/118] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:50.005629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.019847 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.020925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.025207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.025732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.030078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.031671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.039345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 55/119] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:49 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.039345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.121965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eaf7-599f-4831-ae78-e1a780184198 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.154979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608cb2d-fc09-4714-90f5-4a5feb906d1e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.158128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.158788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.159072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.160183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=c06794f152af429aaea22eb44ce4ef7f) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:50.160503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.162829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.168635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 65/120] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/role_assignments?user.id=c06794f152af429aaea22eb44ce4ef7f&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=701406944a8b457a80a0224b59207ce5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.169615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.182546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.188423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.200222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.201114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.201547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.201956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.202846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:50.203250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.204903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.215277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 56/121] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.221133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.319918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97265c3-3a07-43ca-9cfa-1cb14d852e5e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.342010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23b5a5-64ee-4556-8070-ab618d5094c9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.366466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.367874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.368463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.368912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/120c2cefa7e94fae908b308dac4f5403/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.371781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, user_id=120c2cefa7e94fae908b308dac4f5403, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.373994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decaba0-ff74-42c5-be2c-921b9b8a0f9d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.377488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.378614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.378902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.379318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.392263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:50.393021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 66/122] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:24:50 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/120c2cefa7e94fae908b308dac4f5403/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:24:50.394555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda23ed-34a8-4e2b-8e21-54846612e487 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.395593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda23ed-34a8-4e2b-8e21-54846612e487 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.396028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda23ed-34a8-4e2b-8e21-54846612e487 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.397796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 67/123] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:50.402568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda23ed-34a8-4e2b-8e21-54846612e487 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2b93c757-0ab1-4614-b6f0-4018dad919a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:50.413266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:50.414334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:50.415396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:50.417144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 57/124] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:50.418766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.418949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.419322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.454731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:50.456026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:50.495270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.543793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda23ed-34a8-4e2b-8e21-54846612e487 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.545855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.588391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.589791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.590218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.590625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.592277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.594303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.597008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 68/125] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.598829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.637296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 58/126] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:50.638578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.737846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8c6f-10f3-4a83-8e51-aea1e0fb8791 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.794389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.795313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.795742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.796161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.797755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:50.798401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.800398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd12cc-8a07-49fa-ac0a-b72589d8d8ff None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:50.802076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.804046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.819655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 69/127] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.820294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.866965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:50.867848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:50.868139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:50.868416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:50.870325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:50.871793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:50.873552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 59/128] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:50.874330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:50.961771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:50.995345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f374c-92d5-44af-a343-1cd89d3897f1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.052158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9724c-6799-46ee-8165-1e9d88bfc756 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.061119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.063394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.063394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.063394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.094194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.095584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.096004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.096403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.097781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:51.098738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.100777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.102807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 60/129] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:51.103812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:51.108729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:51.109625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:51.110394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:51.117589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 70/130] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:51.118517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.242252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:51.283518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c204e-70b0-45ad-a14a-ad3f5f8263ef None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.300765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8b6d6-c0fb-42b1-a16a-d0bdbfe17477 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.321874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:51.338278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.339157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.339442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.339739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.341147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.342753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.344777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 71/131] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:51 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:51.345591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.374498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.375403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.375686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.375962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/055fbabca2a64bd6aab2d3bd73469ee6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.381049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, user_id=055fbabca2a64bd6aab2d3bd73469ee6, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.382562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.416785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 61/132] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:24:51 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/055fbabca2a64bd6aab2d3bd73469ee6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:24:51.417943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.490364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef5712-0263-4bfb-bce1-0ecedf771016 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.529712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:51.534053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.534684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.534971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.535260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.537661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:51.537977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.539888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.550611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 72/133] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:51.556028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.691134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe416ba-5b17-4fd7-a491-2c0ce5e11101 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.721029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188fa8-6aa3-462a-84af-d77743a84322 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.758841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.759730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.760048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.760326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.761583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.763361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.765408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 73/134] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:51 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:51.774584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.776919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.777859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.778148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.778428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/120c2cefa7e94fae908b308dac4f5403/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.780771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, user_id=120c2cefa7e94fae908b308dac4f5403, role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.782262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.815233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 62/135] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:24:51 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/120c2cefa7e94fae908b308dac4f5403/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:24:51.845613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:51.889319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb954811-5a32-45bf-ad8c-675d66efc652 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:51.930382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:51.931259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.931540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.931810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] PATH_INFO: `/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.933000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] RBAC: Authorizing `identity:get_project(project_id=d90b75f57c6649c4bce6a0fd90e56e6c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:51.934489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988dbd4-8423-42b4-bd8a-57ad407eef1c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:51.936212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 74/136] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:51 2022] GET /identity/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:51.942594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:51.976148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:51.991602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb888-d504-41e0-b5d0-a7fa46a2f016 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.991925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb888-d504-41e0-b5d0-a7fa46a2f016 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.992171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb888-d504-41e0-b5d0-a7fa46a2f016 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:51.993720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 75/137] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:51.998862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:51.999136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:51.999413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.027806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:52.029024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:52.108523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662fa63-74eb-45cb-9890-f89c8ec1c2b3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:52.173164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 76/138] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:52.175392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:52.176545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:52.177342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:52.177629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] PATH_INFO: `/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c/users/120c2cefa7e94fae908b308dac4f5403/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.179658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] RBAC: Authorizing `identity:create_grant(project_id=d90b75f57c6649c4bce6a0fd90e56e6c, user_id=120c2cefa7e94fae908b308dac4f5403, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:52.181125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:52.199536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 63/139] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:24:51 2022] PUT /identity/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c/users/120c2cefa7e94fae908b308dac4f5403/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:24:52.209328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:52.277037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:52.342762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1b0f-8f36-426e-8ea2-a541fb0d20dd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:52.391469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283599-807c-45cd-8518-6488376a7131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:52.392217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283599-807c-45cd-8518-6488376a7131 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:52.392506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283599-807c-45cd-8518-6488376a7131 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:52.392799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283599-807c-45cd-8518-6488376a7131 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.394035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70283599-807c-45cd-8518-6488376a7131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:52.396149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70283599-807c-45cd-8518-6488376a7131 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:52.397918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 77/140] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:52.403633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:52.629176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72fde3-d831-46b4-89f2-f7af0f906889 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:52.653677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:52.664788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:52.665498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:52.665837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:52.666122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.666885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:52.668351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39d49-733f-4987-8832-f9aae5fa9e2a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:52.701014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 64/141] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:24:52 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:52.758836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14fc1-4a64-488b-98a9-2c4607105926 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:52.759175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14fc1-4a64-488b-98a9-2c4607105926 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:52.759402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d14fc1-4a64-488b-98a9-2c4607105926 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.761020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 78/142] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:52.767180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:52.767477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:52.767761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:52.788802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:52.790088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:52.882364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 65/143] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:52.918411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14fc1-4a64-488b-98a9-2c4607105926 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.060957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d14fc1-4a64-488b-98a9-2c4607105926 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.082601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:53.104559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.105596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.105710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.108463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.122479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-140c150a-0ef2-47db-b461-ca93e3d381a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:53.130846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:53.131728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:53.132493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 79/144] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:53.139314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.242267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:53.259595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535dee-14eb-4e71-8dc4-268c60d135b0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.260137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535dee-14eb-4e71-8dc4-268c60d135b0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.260339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7535dee-14eb-4e71-8dc4-268c60d135b0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.261926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 80/145] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:53.266806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e58b0-d1e3-463d-96e2-59da8741e9e3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.268572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.268866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.269147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.292678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:53.293933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:53.305328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.306008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.306293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.306570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.307327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:53.307633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:53.309025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:53.318317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 66/146] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:53.324110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.403199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 81/147] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:24:53.451593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7438f7-5af1-4695-9345-bd0213dbc56e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.453278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.533982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.534846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.535138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.535420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] PATH_INFO: `/v3/users/c06794f152af429aaea22eb44ce4ef7f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.536990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] RBAC: Authorizing `identity:get_user(user_id=c06794f152af429aaea22eb44ce4ef7f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:53.538502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:53.540325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 67/148] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/users/c06794f152af429aaea22eb44ce4ef7f => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:53.546568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.571048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:53.578600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e2c5f-15c4-4480-8467-9c23e02a4929 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.595635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:53.640589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.641411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.641695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.641969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.668620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:53.689616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:53.690525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:53.691276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 82/149] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:24:53.698658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.733441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de994e7-c886-4888-9cef-265463f3e2fa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.794914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.795883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.796176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.796459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.797765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:53.799241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:53.805743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 68/150] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:53.812225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.843679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093b543-93c7-466d-915e-933c65988ce3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:53.897298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:53.897979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:53.898255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:53.898525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:53.899280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:53.899580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:53.900971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:53.917757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 83/151] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:53.925742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:53.975621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:54.013590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:54.041919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde2ab-1da5-4073-b29e-146187605750 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:54.119471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:54.120380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:54.120669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:54.120949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/c06794f152af429aaea22eb44ce4ef7f/roles/701406944a8b457a80a0224b59207ce5` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:54.124485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, user_id=c06794f152af429aaea22eb44ce4ef7f, role_id=701406944a8b457a80a0224b59207ce5)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:54.125968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:54.158329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181260c-0440-4bdc-bb9e-61a999e54ee6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:54.163900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 69/152] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:24:53 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/users/c06794f152af429aaea22eb44ce4ef7f/roles/701406944a8b457a80a0224b59207ce5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:24:54.203239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:54.204138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:54.204415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:54.204690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:54.206813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:54.208635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:54.210711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 84/153] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:53 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:54.216609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:54.341685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7dd86-08c6-46d3-a3bd-5ff914c8474c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:54.379107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:54.379843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:54.380126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:54.380402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:54.384459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:54.463130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:54.464642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:54.580752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 70/154] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:54.586780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:54.720892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:54.725563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83c56f-7fc5-4a04-af22-9acd1d3efd52 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:54.763669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:54.764788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:54.765233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:54.765650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:54.769969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:54.771701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc1e2-e4fd-410d-8930-01b86d66df19 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:54.773952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 85/155] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:54 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:54.780074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:54.849585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:54.932002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e44235-ebcf-4650-85e9-79942fbdee7d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:54.968140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:54.968805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:54.969089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:54.969390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:54.970230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:54.970538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:54.972056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362487b-10ae-40a6-a7c5-071e33f58c4e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:54.978526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 71/156] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:54 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=7df455d940c54f13b78a737b9c240982 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:55.016863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d061e-add4-46af-9955-7b26c1c7c473 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.017541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d061e-add4-46af-9955-7b26c1c7c473 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.018020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d061e-add4-46af-9955-7b26c1c7c473 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.020538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 86/157] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:55.039656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.040005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.040218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.062335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:55.063582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:55.164297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 72/158] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:55.199733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d061e-add4-46af-9955-7b26c1c7c473 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:55.346455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d061e-add4-46af-9955-7b26c1c7c473 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:55.384685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:55.385513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.385795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.386072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.399444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:55.407415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:55.408345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:55.409159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:55.413291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 87/159] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:55.415144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:55.461595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:55.526818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c5b34-603a-4633-9757-a2d6f4504b97 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:55.564038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:55.564722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.565002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.565312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.566065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:55.566363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:55.567788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:55.576969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 73/160] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:55.583076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:55.618533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:55.705977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4fc31-3f27-4910-a1c0-7ad75069f8cb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:55.748562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:55.749480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.749760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.750036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] PATH_INFO: `/v3/users/055fbabca2a64bd6aab2d3bd73469ee6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.752493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] RBAC: Authorizing `identity:get_user(user_id=055fbabca2a64bd6aab2d3bd73469ee6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:55.754813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d356e4-7609-4b7c-ad2b-2e77b8e7f21e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:55.757076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 88/161] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:55 2022] GET /identity/v3/users/055fbabca2a64bd6aab2d3bd73469ee6 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:55.763151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:55.869807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:55.874844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed449634-d122-4de3-a947-86d0221107c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:55.912390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:55.913048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:55.913364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:55.913645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:55.984738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:55.986234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582578f1-6e1b-425e-876a-eb70afa41d3c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:56.079560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:56.100608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806c16-455a-493b-8818-5bc8d6432ce5 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.100898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806c16-455a-493b-8818-5bc8d6432ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.101162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806c16-455a-493b-8818-5bc8d6432ce5 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.102682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 89/163] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:24:56.102868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 74/163] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:56.104792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806c16-455a-493b-8818-5bc8d6432ce5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:56.115208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ee36-e784-437c-905e-314b1fe9a398 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.115498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ee36-e784-437c-905e-314b1fe9a398 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.115778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ee36-e784-437c-905e-314b1fe9a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.150833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4103ee36-e784-437c-905e-314b1fe9a398 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:56.151947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4103ee36-e784-437c-905e-314b1fe9a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:56.287376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 75/164] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:56.289546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:56.289824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0a3-173f-4c08-bf7b-3d5c60bb545e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.290124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0a3-173f-4c08-bf7b-3d5c60bb545e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.290642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebf0a3-173f-4c08-bf7b-3d5c60bb545e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.292053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 76/165] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:56.298568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.298849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.299184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.302925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806c16-455a-493b-8818-5bc8d6432ce5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:56.333866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:56.335468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:56.360594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:56.361562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.361899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.362180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.366058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:56.368494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:56.370426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 90/166] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:24:56.371529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:56.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 77/167] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:56.504932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:56.564984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734db5d-bb7b-42a0-bd16-4c59b31d612a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:56.605140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:56.606381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.606855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.607325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.619956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:56.628507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:56.630606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:24:56.631535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:56.633914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 91/168] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:56.634932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:56.640569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:56.668609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:56.737520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9b90e-e89d-4e1f-9f13-a4b265f0902d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:56.801245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c4b5b-69f3-488d-8f3b-834ba42e284b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:56.830460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:56.833096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.834808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.835912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.837148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=055fbabca2a64bd6aab2d3bd73469ee6) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:56.840139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:56.841849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:56.857921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 78/169] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/role_assignments?user.id=055fbabca2a64bd6aab2d3bd73469ee6&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:56.859220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:56.885040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:56.886229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:56.886743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:56.887203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:56.919833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:56.945142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:56.946100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:56.946859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:24:56.951093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 92/170] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:56.958709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.125869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978caa-65c8-4170-9ff2-1b76febd615c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.144900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.168699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.169415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.169697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.169971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.170840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:57.171148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:57.172534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7daf2-83c9-4cfd-8cfb-a24e3abe951d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:57.175412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.185518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 79/171] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:57.187477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9c42-6efd-4f4a-b679-e6ae36410232 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.187771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9c42-6efd-4f4a-b679-e6ae36410232 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.188047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a9c42-6efd-4f4a-b679-e6ae36410232 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.189693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 80/172] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:57.195442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9c42-6efd-4f4a-b679-e6ae36410232 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.211071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa779b-346c-4b3e-8123-c691ef682d03 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.276183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.276869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.277151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.277452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.278216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:57.278519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:57.279906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cbdc8-c997-4cf3-ac36-64d2b3fe5be9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:57.299181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 93/173] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:24:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:57.303422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.303714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.305595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.340581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:57.341808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:57.389937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a9c42-6efd-4f4a-b679-e6ae36410232 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.460165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.461056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.461365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.461640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.463013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:57.464467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:57.466315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 81/174] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:57.469989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.490891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 94/175] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:57.492576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.536625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.587273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.602315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b8e3-e9a8-4547-bf10-fb0d40b30f1c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.611265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6adc0-5b0b-4fa4-89ea-cba9b67ab97a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.647935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.649318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.649533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.649954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.650208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.650491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.650676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.650776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] PATH_INFO: `/v3/users/120c2cefa7e94fae908b308dac4f5403` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.653956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] RBAC: Authorizing `identity:get_user(user_id=120c2cefa7e94fae908b308dac4f5403)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:57.655576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:57.658265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 82/176] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/users/120c2cefa7e94fae908b308dac4f5403 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:57.659060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.721693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:57.724101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:57.785321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd69328-53ef-4ba1-946e-b9b8ca26ef50 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.802278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.810539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:57.828318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.829468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.829921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.830426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.836163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 95/177] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:57.837014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.843669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-83a04cb9-1ce0-4aea-aee4-062d42e19a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:57.852304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:57.853368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:24:57.854327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:57.856711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 83/178] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:57.858439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82f6-ee78-4c0c-a681-65128d15e424 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.858872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82f6-ee78-4c0c-a681-65128d15e424 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.859310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82f6-ee78-4c0c-a681-65128d15e424 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:57.860730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 84/179] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:57.861741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db82f6-ee78-4c0c-a681-65128d15e424 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:57.942470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86e68f-c9fe-4e4f-ac9b-8af32612ad93 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.976524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db82f6-ee78-4c0c-a681-65128d15e424 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:57.981667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:57.982666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:57.983160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:57.983666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.013133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.014040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.014321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.014598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] PATH_INFO: `/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.015868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] RBAC: Authorizing `identity:get_project(project_id=d90b75f57c6649c4bce6a0fd90e56e6c)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.017419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1894ced-c0e7-4eb9-9caa-4b0cf9654151 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.024046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 85/180] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/projects/d90b75f57c6649c4bce6a0fd90e56e6c => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.024046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.024046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.024046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.039773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:58.040970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:58.042096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.065617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.067668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e9de-9470-41a4-a7d9-af18cef9ea76 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.076955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.110798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 86/181] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:58.111646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.172922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 96/182] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:58.174298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a289-bb49-4780-b1f4-aaf382b1fda5 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.174587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a289-bb49-4780-b1f4-aaf382b1fda5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.174863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a289-bb49-4780-b1f4-aaf382b1fda5 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.176784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 97/183] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:58.177504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a289-bb49-4780-b1f4-aaf382b1fda5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.216589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c89ddd-13d7-407a-b5bd-ce1db0d3fe70 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.250456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.251125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.251409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.251686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.252089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.252438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:58.252986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.254226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb9cb4-db42-4123-8f1f-7b942c1849b2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.262543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 87/184] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.263877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c521-631b-4a82-b004-1b72fd4f6dd9 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.264164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c521-631b-4a82-b004-1b72fd4f6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.264447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c521-631b-4a82-b004-1b72fd4f6dd9 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.265702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 88/185] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:24:58.266402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c521-631b-4a82-b004-1b72fd4f6dd9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.279096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a289-bb49-4780-b1f4-aaf382b1fda5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.301726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.313382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.314037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.314314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.314581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.315419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=d90b75f57c6649c4bce6a0fd90e56e6c, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:58.315719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.317462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.323201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 98/186] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=d90b75f57c6649c4bce6a0fd90e56e6c&role.id=7df455d940c54f13b78a737b9c240982 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.334151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.380680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c521-631b-4a82-b004-1b72fd4f6dd9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.423363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.424188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.424465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.424740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.436874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d03766c2-973f-4e4b-b8f5-a988091cef57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:58.445054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:58.446038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 89/187] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:58.452203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a9e1-b009-4b4f-9c3d-36c17ce8ff3e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.452945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a9e1-b009-4b4f-9c3d-36c17ce8ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.452945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5a9e1-b009-4b4f-9c3d-36c17ce8ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.465446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-60c5a9e1-b009-4b4f-9c3d-36c17ce8ff3e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:58.466717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-60c5a9e1-b009-4b4f-9c3d-36c17ce8ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:58.467902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82c83c-a2b2-4499-a458-3da7b83b230e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.507543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.508526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.509242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.509242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.512041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.513875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.515753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 99/188] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.521269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.528477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.563332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 90/189] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:58.564792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.565146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.565505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.582866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:24:58.583956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:24:58.601654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.633252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225d0d7-09c8-4a53-bdb4-f9d315684a26 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.652923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 91/190] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:24:58.653802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.666717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.667585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.667892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.668132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.681920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.683381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.685056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 100/191] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.685842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.750474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.768137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858f01e-d69c-415c-9721-aa1d69f51d74 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.786973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93673cf-a9aa-4b45-add1-deb9e28a55fb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.802165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.803196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.803619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.803900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.804654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:58.804964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.806386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.815025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 92/192] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.815803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.822595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.823261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.823544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.823819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.824664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=120c2cefa7e94fae908b308dac4f5403) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:58.824979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.826472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.832791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 101/193] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/role_assignments?user.id=120c2cefa7e94fae908b308dac4f5403&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.837319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.838143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:58.945920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8cf2-fcca-49f5-8f42-20335afcd335 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.949347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0f86-3a46-425f-a81b-602d12d88a94 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:58.981884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:58.984744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.986554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.986554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.986554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.988963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:58.989798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:58.990078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:58.991574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:58.992150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:58.994045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:58.995441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 102/194] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:58.996060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.001472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:24:59.011090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:24:59.012017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:24:59.013069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 93/195] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:24:59.013746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.094982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.114466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac3517-6ac6-49b2-9725-656b192792fc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.127916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7c781-77e3-4c55-94b7-017751bc51cf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.149485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.150142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.150423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.150698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.162039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.162908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.163189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.163465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] PATH_INFO: `/v3/users/c06794f152af429aaea22eb44ce4ef7f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.164656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c06794f152af429aaea22eb44ce4ef7f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.166129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.167945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 94/196] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/users/c06794f152af429aaea22eb44ce4ef7f => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:59.168489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.220336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.224246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.225923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.267185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eb8a7-12dd-436f-a52b-bf484d9788b9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.301404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.302074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.302361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.302645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.303356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.304804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.320114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.325271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 103/197] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:59.325494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 95/198] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:24:59 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:24:59.326337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.326556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.442374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.442743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81257fde-b6b9-44f5-ab1d-7f3d89d15fa3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.447003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30a88-4980-41bf-a1f2-a652b05933f0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.482354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.483018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.483303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.483582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.486987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.487661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.487944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.488217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.489630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:59.489946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.491362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.500905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 104/199] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:59.502085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.576890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.583511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.585007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.631830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e40d8b-d6c5-4f4b-8c1e-388096c047ee None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.691204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.695210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.695210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.695210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.695429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.697508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.700550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 105/200] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:59.701709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.706755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 96/201] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:24:59.708312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.741152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.818972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:24:59.822261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3d351-fc08-43b8-8ada-cf356cba1a76 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.848910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993d9e8-5065-48ab-a205-c6258ff8fb15 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:24:59.868419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.869179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.869558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.870375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.871511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=93a89ecdc1ba497d908b67ffcddbd8ec) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:24:59.871834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.874095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.883065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 97/202] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/role_assignments?user.id=93a89ecdc1ba497d908b67ffcddbd8ec&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:59.884298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:24:59.885467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:24:59.886360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:24:59.886644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:24:59.886922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:24:59.888448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:24:59.890031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:24:59.891951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 106/203] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:24:59.898155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:00.052828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37f05a-6599-4f38-be62-b87352714902 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:00.058976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:00.068194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f42bb-81e9-490b-bbcf-82915d31e574 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:00.116918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:00.117830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:00.118114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:00.118393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:00.119716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:00.119951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:00.120619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:00.120907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:00.121203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:00.121295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:00.123320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 98/204] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:00.131239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:00.186492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:00.276186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:00.277703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:00.282196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057af11-8feb-4c20-86be-eaff26e878b7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:00.345632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:00.346690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:00.347186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:00.347655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:00.348755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, scope.project.id=1518a0750d864e4dae2087c9d5e01396, user.id=c06794f152af429aaea22eb44ce4ef7f) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:00.349301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:00.350972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:00.359096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 99/205] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:00 2022] GET /identity/v3/role_assignments?user.id=c06794f152af429aaea22eb44ce4ef7f&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=701406944a8b457a80a0224b59207ce5 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:00.446031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:00.453424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 107/206] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:00.460401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:00.578631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:00.586056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c441-6d08-4f8f-bc47-a5940f180404 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:00.624721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:00.625616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:00.625898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:00.626172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:00.627373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:00.628828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fae4f5-808d-496b-b3cb-ec86a3942ad7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:00.630719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 100/207] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:00 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:00.636646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:00.763072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba0ee1-ca10-4784-b5b5-620917d8810a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:00.808154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:00.808824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:00.809103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:00.809405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:00.810248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=93a89ecdc1ba497d908b67ffcddbd8ec) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:00.810555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:00.812012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee1603-e530-4823-aed7-63760139ca43 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:00.821254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 108/208] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:00 2022] GET /identity/v3/role_assignments?user.id=93a89ecdc1ba497d908b67ffcddbd8ec&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:01.739653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b472-ec83-444f-902d-c623bc574fe3 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:01.740194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b472-ec83-444f-902d-c623bc574fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:01.740194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b472-ec83-444f-902d-c623bc574fe3 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:01.741871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 101/209] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:01.747118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:01.747410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:01.747691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:01.767856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:01.769065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:01.823406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007317-6c69-4110-89dd-5fd6f81d6053 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:01.824031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007317-6c69-4110-89dd-5fd6f81d6053 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:01.824539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14007317-6c69-4110-89dd-5fd6f81d6053 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:01.827356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 102/210] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:01.829908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:01.832851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:01.833553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:01.834040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:01.843556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 109/211] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:01.852595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:01.854133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:01.868982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:01.947657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 103/212] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:01.972335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:01.996371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a85e-a284-422c-9557-ad6146f43518 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.041347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.042394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.042824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.043710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.057769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:02.067692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:02.068781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:02.069789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:02.072332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 110/213] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:02.079203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.101719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.116426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e1d3-0371-497a-9748-c207f2bb679f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.148290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.156016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.156814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.157100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.157405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.158576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.160037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fe794-c497-4dc4-9ad1-8f4f96c5ba04 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.162337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 104/214] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:02.162337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4cbc-3941-400c-a4fc-f6e836f45349 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.162337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4cbc-3941-400c-a4fc-f6e836f45349 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.162337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa4cbc-3941-400c-a4fc-f6e836f45349 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.162337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 105/215] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:02.168383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4cbc-3941-400c-a4fc-f6e836f45349 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.212079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2c00a-48f8-4651-b464-238df5a28cd7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.246662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.247266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.247550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.247831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.248979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:02.249326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.251081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7d61-6997-40ad-ac48-21d51fe50aba None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.261892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 111/216] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:02.268143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.268591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.268879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.276683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa4cbc-3941-400c-a4fc-f6e836f45349 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.286136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:02.287334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:02.313910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.314842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.315311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.315657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.316526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.318741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.342011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 106/217] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:02 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:02.342676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.366771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.372289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 112/218] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:02.400185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.451357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.468343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893488-2297-45fa-a925-74eb40ef788f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.507326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.508223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.508577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.508865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] PATH_INFO: `/v3/users/56e5a2ee7e664106a2ea511e67360897` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.516714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a620c2-1dee-4484-a5e3-99adafa42d23 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.524583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] RBAC: Authorizing `identity:get_user(user_id=56e5a2ee7e664106a2ea511e67360897)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.526113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.528931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 107/219] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/users/56e5a2ee7e664106a2ea511e67360897 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:02.534710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.566030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.567893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.568433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.568655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.579974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:02.588818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:02.589945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:02.590730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:02.595233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 113/220] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:02.596143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.647699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.682787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8011b-596b-4ee5-9e29-eb606b7ff4ce None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.720934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.721726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.722013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.722296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.727720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d085f57-c231-4994-806f-6614d95a6582 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.729301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.765035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.765674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.765959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.766288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.767060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:02.767367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.768758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.777897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 114/221] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:02.784818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.805621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.807922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c473c-be22-413a-b299-3172f4c94ed6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.896613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01bc09-1573-401f-a40d-f93ab7f54143 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:02.932980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:02.933590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:02.934200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.934310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.934588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.936110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:02.937639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:02.939956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 115/222] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:02.945637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.964992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 108/223] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:02.966423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622bae-7196-4db9-94b7-c29281e67dd4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:02.966720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622bae-7196-4db9-94b7-c29281e67dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:02.967002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b622bae-7196-4db9-94b7-c29281e67dd4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:02.968424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 109/224] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:02.970051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b622bae-7196-4db9-94b7-c29281e67dd4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:02.981561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:03.073938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc82e8-661a-4e1e-a81a-98ec8e4406de None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.080157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b622bae-7196-4db9-94b7-c29281e67dd4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.109885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.110672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.110957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.111232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.114585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.116061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510da4c-bf66-4818-8f32-9aff1b1ed865 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.122886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 116/225] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:03.124258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f100f-574f-45aa-93c8-10c553916783 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.124546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f100f-574f-45aa-93c8-10c553916783 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.124828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f100f-574f-45aa-93c8-10c553916783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.126418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.127569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.128071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.128589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.130906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.132649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.141311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 110/226] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:02 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:03.142712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:03.143921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-121f100f-574f-45aa-93c8-10c553916783 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:03.145219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-121f100f-574f-45aa-93c8-10c553916783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:03.190962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:03.221096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 117/227] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:03.222081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f100f-574f-45aa-93c8-10c553916783 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:03.252513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e865f8-263f-40fa-9057-e7586a6f8a73 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.264279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:03.300039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.302597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.303087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.303584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/93a89ecdc1ba497d908b67ffcddbd8ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.306649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, user_id=93a89ecdc1ba497d908b67ffcddbd8ec, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.308803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.327794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 111/228] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:03 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/93a89ecdc1ba497d908b67ffcddbd8ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:03.329164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:03.366614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f100f-574f-45aa-93c8-10c553916783 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.443646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.444323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.444667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.444859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.445732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=56e5a2ee7e664106a2ea511e67360897) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:03.446041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.447644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.457098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4dd21-2914-4cb5-bc56-aa00cd7ba20a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.461561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:03.464511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 118/229] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:03 2022] GET /identity/v3/role_assignments?user.id=56e5a2ee7e664106a2ea511e67360897&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=7df455d940c54f13b78a737b9c240982 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:03.504561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.506014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.506294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.506627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.520379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:03.529020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:03.529998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:03.530780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 112/230] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:03.538582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:03.672263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:03.681274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fcb6f-272c-41c7-9dbd-1d8ca30a25df None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.718565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.719238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.719518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.719789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.720536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:03.720838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.722245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.731277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 119/231] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:03.736796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:03.878237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616829d-c979-418f-ad42-c92a169ab492 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:03.921459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:03.922404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:03.922633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:03.922915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:03.924129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:03.925619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:03.928120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 113/232] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:03 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:03.938311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:04.057693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067483-9dc1-447c-985c-5c99bca7642b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:04.096936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:04.097905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:04.098291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:04.098568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:04.099771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:04.101249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b9a15-7d9f-4dd6-89e4-65b2e309152d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:04.102984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 120/233] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:03 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:04.108658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:04.149391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:04.255996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f72c7-275c-49ce-9269-2167e2a2ba68 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:04.302912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:04.303816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:04.304098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:04.304379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/93a89ecdc1ba497d908b67ffcddbd8ec/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:04.306663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, user_id=93a89ecdc1ba497d908b67ffcddbd8ec, role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:04.308122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6237c-ad99-499a-97ab-6a6f38430e7c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:04.339914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 114/234] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:04 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/93a89ecdc1ba497d908b67ffcddbd8ec/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:04.876000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084ff0-6638-4fb7-b1d7-d7169ae3b274 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:04.876400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084ff0-6638-4fb7-b1d7-d7169ae3b274 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:04.876574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084ff0-6638-4fb7-b1d7-d7169ae3b274 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:04.878192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 121/235] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:04.884835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-672c-4dd6-85a7-becd1dc752b7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:04.884835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-672c-4dd6-85a7-becd1dc752b7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:04.888095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-672c-4dd6-85a7-becd1dc752b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:04.910717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8ec8e52a-672c-4dd6-85a7-becd1dc752b7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:04.911924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8ec8e52a-672c-4dd6-85a7-becd1dc752b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:05.009704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 115/236] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:05.027861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aaac4-4348-4023-be0e-874a91af435c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.027861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aaac4-4348-4023-be0e-874a91af435c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.027861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4aaac4-4348-4023-be0e-874a91af435c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.028886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 122/237] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:05.034459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.034752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.035036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.041259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aaac4-4348-4023-be0e-874a91af435c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.067905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:05.069634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:05.095071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:05.098200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:05.186579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 116/238] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:05.196877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4aaac4-4348-4023-be0e-874a91af435c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.232201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.232665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.233506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.233789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.234070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.246793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:05.264582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:05.265524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:05.266308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:05.270654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 123/239] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:05.273771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.416651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773127d5-8d03-412b-bc7b-54f6cb578f15 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.433954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:05.460508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcbe0f-253a-419b-ba71-3ae8ede8d2aa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.485148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.485969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.486246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.486512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.489630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:05.491103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:05.492915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 117/240] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:05.500149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.528193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:05.542464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.543153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.543436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.543711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.544474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:05.544779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:05.546231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:05.564425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 124/241] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:05.582799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.617627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52412ab-0880-470a-b1dc-a2e1b709a6c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.653703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.654378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.654656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.654929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.655649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:05.657090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:05.681240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 118/242] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:05 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:05.758787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d4d1-4a09-44bc-8dd2-0bb95b36abea None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.798204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.799099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.799381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.799652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] PATH_INFO: `/v3/users/378706ad92f34dc68a147c84d64186d3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:05.814899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] RBAC: Authorizing `identity:get_user(user_id=378706ad92f34dc68a147c84d64186d3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:05.817068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831dfc0-c051-4789-bad6-59e43a7e1594 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:05.818881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 125/243] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:05 2022] GET /identity/v3/users/378706ad92f34dc68a147c84d64186d3 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:05.824625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:05.908642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:05.940869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94b96-afd0-4934-9baa-71ed87cdda2d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:05.986784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:05.987441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:05.987724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:05.987999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.062745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:06.064151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bee08-3141-4f21-bca9-6007ecc97800 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:06.079272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c1c8-6215-40c0-90c5-7c668a69a8aa None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.079762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c1c8-6215-40c0-90c5-7c668a69a8aa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.080026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c1c8-6215-40c0-90c5-7c668a69a8aa None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.081785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 126/244] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:06.083571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413cf6e-0b83-4d0d-9406-d7aad269c858 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.089492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413cf6e-0b83-4d0d-9406-d7aad269c858 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.089784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413cf6e-0b83-4d0d-9406-d7aad269c858 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.091355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 127/245] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:06.092381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.092665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.092945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.104931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.121174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:06.122441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:06.165919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.196148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 119/246] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:06.197507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.197802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.198082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.219248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:06.220403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 128/247] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:06.220521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:06.221639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.309532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 120/248] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:06.310458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.346850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa3194-c295-45c5-9009-c121359f5213 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.386731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.388239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.388723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.389288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.390654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:06.392487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:06.394966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 129/249] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:06.400782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.411399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.432889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12b9be-be98-4f2e-8fd3-0a6da52f32de None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.442006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.471136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.471991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.472283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.473153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.484338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:06.492401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:06.493332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:06.494122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 121/250] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:06.494871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.515641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73801d4-06d2-4c12-90eb-301638d54963 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.555830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.556671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.556962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.557336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.570997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:06.578814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:06.579702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:06.580484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 130/251] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:06.581141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.620577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71bd7b-3c1b-471d-8783-1a94c2872b3e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.665550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.666508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.666797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.667073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.668189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=378706ad92f34dc68a147c84d64186d3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:06.668498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:06.670032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:06.677129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 122/252] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/role_assignments?user.id=378706ad92f34dc68a147c84d64186d3&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=701406944a8b457a80a0224b59207ce5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:06.678125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.688082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.737759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:06.835239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012d25-47df-4aff-bcab-5fc03da733ce None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.851252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ab6b-a045-48a3-8716-4f6b7c334553 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:06.875192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.876367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.876655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.876937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.877736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:06.878072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:06.880085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:06.890072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 123/253] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:06.899503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:06.919802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:06.920488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:06.920777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:06.921057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:06.921876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:06.922189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:06.923639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:06.943766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 131/254] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:06.949245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:07.021694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3b586-dd48-4167-af1b-a7b5f4d79a71 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:07.025485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:07.065621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:07.067189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.067481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.067750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] PATH_INFO: `/v3/users/56e5a2ee7e664106a2ea511e67360897` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.068983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] RBAC: Authorizing `identity:get_user(user_id=56e5a2ee7e664106a2ea511e67360897)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:07.071504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:07.073504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 124/255] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/users/56e5a2ee7e664106a2ea511e67360897 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:07.086364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:07.211004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635c181-89a4-4072-8e90-d2c4c5c26f44 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:07.252894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:07.271497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a879466-29a3-4dcf-b0a8-baf234461296 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:07.274862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:07.275754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.276035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.276310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.278125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:07.279580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794c18e-3b2e-4aeb-833b-46c17f3263ed None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:07.285667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 132/256] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:06 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:07.286924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616b6a-b098-45f4-82c1-0f844a4ae511 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.287209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616b6a-b098-45f4-82c1-0f844a4ae511 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.287487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616b6a-b098-45f4-82c1-0f844a4ae511 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.288920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 133/257] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:07.289500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616b6a-b098-45f4-82c1-0f844a4ae511 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:07.343240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:07.349260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.349550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.349826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.365224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:07.368774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003aa23-21ca-4ac3-a191-c6ac4637e9f5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:07.369999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 125/258] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:07 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:07.373453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.373453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.373453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.412486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:07.413885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:07.465208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:07.519434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616b6a-b098-45f4-82c1-0f844a4ae511 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:07.567429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 126/259] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:07.568761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:07.603540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:07.605264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.605264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.605264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.737052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:07.760052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:07.764426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:07.795116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0db0b-e909-4680-b3ad-ad0119027b7e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:07.872593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:07.873512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:07.873790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:07.874060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/56e5a2ee7e664106a2ea511e67360897/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:07.885211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, user_id=56e5a2ee7e664106a2ea511e67360897, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:07.885211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:07.914765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 127/260] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:07 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/56e5a2ee7e664106a2ea511e67360897/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:07.915729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:07.965236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:07.992119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 134/261] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:07.998092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:08.185770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:08.197068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b37ca4-1d1e-4447-bd78-7126379ec900 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:08.215328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54f555-9a47-4486-9d03-d1a0bd41e865 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:08.256812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:08.257647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.257928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.258202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.260858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:08.262350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:08.269065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 135/262] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:07 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:08.273681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:08.274537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.274826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.275106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.276592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:08.309156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:08.321611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:08.322531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:08.323397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 128/263] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:08.330220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:08.457846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67376b2-6fb9-4d57-bcc2-2feda4a51ca3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:08.481557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:08.523020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:08.523611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.523892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.524204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.525049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=93a89ecdc1ba497d908b67ffcddbd8ec) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:08.525379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:08.526823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:08.539686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 136/264] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:08 2022] GET /identity/v3/role_assignments?user.id=93a89ecdc1ba497d908b67ffcddbd8ec&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:08.542836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96812e12-104b-451c-ae3d-90899cd30ea2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:08.618837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:08.619913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.620416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.620893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.621881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:08.622393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:08.624013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:08.638450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 129/265] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:08.644401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:08.693505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:08.799793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcd5c0-c0d4-4841-9afc-42f45f6cdef2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:08.842004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:08.842881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.843156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.843425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] PATH_INFO: `/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.844631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] RBAC: Authorizing `identity:get_user(user_id=93a89ecdc1ba497d908b67ffcddbd8ec)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:08.846092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecf35-73d1-4753-91dd-80492a043463 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:08.849148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 137/266] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:08 2022] GET /identity/v3/users/93a89ecdc1ba497d908b67ffcddbd8ec => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:08.854779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:08.952993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9085-1469-4aac-bf98-1a45f5412915 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.953392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9085-1469-4aac-bf98-1a45f5412915 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.953600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9085-1469-4aac-bf98-1a45f5412915 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.955296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 138/267] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:08.962439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:08.962721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:08.962993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:08.990466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:08.991672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:09.033069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75c21-2811-44bd-9f9c-681b950c66a3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.068113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 139/268] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:09.091616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.092279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.092563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.092838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.098725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.129596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.138164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.225503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.228149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc799f-7178-4dcc-955c-3dcb1f0664af None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.245679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3a82e-7f7e-44b8-b950-bb9b9417fa3f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.289031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.290084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.290463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.290837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.305015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b92b3f8e-8fd6-48bc-8762-a76c0f5714d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:09.314861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:09.315782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:09.317427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 140/269] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:09.322210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c72ab-5a3d-417f-9ca0-06f412e0b6d4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.322700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c72ab-5a3d-417f-9ca0-06f412e0b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.322982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c72ab-5a3d-417f-9ca0-06f412e0b6d4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.324471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 141/270] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:09.325038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c72ab-5a3d-417f-9ca0-06f412e0b6d4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.358694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 130/271] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:09.360479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.360976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.361474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.380861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:09.382481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:09.421092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.422941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.446018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c72ab-5a3d-417f-9ca0-06f412e0b6d4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.469473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 131/272] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:09.469473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.490150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.490828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.491113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.491391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.492146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:09.492451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.493870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee590-af30-409d-912c-9048434b02d8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.502669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 142/273] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:09.504122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1a98-d430-433c-be83-e155b90c2825 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.504435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1a98-d430-433c-be83-e155b90c2825 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.504715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1a98-d430-433c-be83-e155b90c2825 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.509223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 143/274] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:09.509223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1a98-d430-433c-be83-e155b90c2825 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.589353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97717569-6103-4a90-a2c6-62966d5d356b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.620240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1a98-d430-433c-be83-e155b90c2825 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.637748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.638976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.639267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.639553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.640784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.642345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.644217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 132/275] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:09.649859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.656191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.657047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.657368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.657647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.658930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.660967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aac4b-0993-4a23-8f9e-097f0197c1ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.667243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 144/276] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:09.668292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.668587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.668886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.685705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:09.687017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:09.692368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.695532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.759012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3765ab-6d46-48c0-970a-007cb38c774b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.760133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 145/277] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:09.760982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.805590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.806804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.807380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.807854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] PATH_INFO: `/v3/users/844edc82ad7b4f1884b2a2f156865d07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.822156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] RBAC: Authorizing `identity:get_user(user_id=844edc82ad7b4f1884b2a2f156865d07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.823940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.825887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 133/278] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/users/844edc82ad7b4f1884b2a2f156865d07 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:09.831310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.877722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45199824-0e6b-4393-be99-d46ea3379eca None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.913083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:09.913779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:09.914062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:09.914338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:09.915173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=93a89ecdc1ba497d908b67ffcddbd8ec) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:09.915484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:09.916951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:09.923052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 146/279] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/role_assignments?user.id=93a89ecdc1ba497d908b67ffcddbd8ec&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:09.923839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:09.933482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.953543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:09.961836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ecccf-700e-431b-867b-6679e4338e3f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:09.999773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.000466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.000755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.001039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.001808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.003324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.045231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 134/280] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:09 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:10.045231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.091760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4b6ea-422f-4ee1-87e2-a7f1dbf17585 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.149786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.150627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.151158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.151512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.168294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:10.178517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:10.179695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:10.180721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:10.182289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 147/281] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:10.198788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.204545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745de50-31f2-4e4f-b175-a58389337f08 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.247256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.248590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.249022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.249481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.250487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, user.id=844edc82ad7b4f1884b2a2f156865d07, scope.system=all) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:10.250946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.252554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.260073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 135/282] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/role_assignments?user.id=844edc82ad7b4f1884b2a2f156865d07&scope.system=all&role.id=7df455d940c54f13b78a737b9c240982 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:10.288500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:10.334114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974f276-306e-4982-bb6d-cb5d7c0220e0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.372884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.373612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.373893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.374166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.374925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:10.375227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.376631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.386823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 148/283] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:10.392993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.415010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:10.509562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5da854-f62a-4518-ad3b-8304d7a961c4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.549164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.550121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.550408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.550883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] PATH_INFO: `/v3/users/378706ad92f34dc68a147c84d64186d3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.552129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] RBAC: Authorizing `identity:get_user(user_id=378706ad92f34dc68a147c84d64186d3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.553649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03deb20d-5ad2-4693-b3a3-0ef7baae9c25 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.555674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 136/284] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/users/378706ad92f34dc68a147c84d64186d3 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:10.561175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.594948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b853-ec5c-4bcd-9090-2386325d053c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.595229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b853-ec5c-4bcd-9090-2386325d053c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.595510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723b853-ec5c-4bcd-9090-2386325d053c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.596889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 137/285] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:10.603751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.604168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.604531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.624645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:10.627208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:10.679202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca7b05-dd1a-4624-acc1-0469a5aa3ab2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.705892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 138/286] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:10.713686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:10.719590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.720694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.721151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.721625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.723788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.725477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.727679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 149/287] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:10.733435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.733685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.750671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:10.849844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a4648-60f3-43c5-a08c-14b363bc5960 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.879603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5527b9d-27b4-4e04-8870-47951c75c02b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:10.888054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.888852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.889136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.889436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.901685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:10.909592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:10.911211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:10.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:10.912583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 139/288] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:10.918047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:10.950916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:10.952165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:10.952644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:10.953118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/378706ad92f34dc68a147c84d64186d3/roles/701406944a8b457a80a0224b59207ce5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:10.955366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, user_id=378706ad92f34dc68a147c84d64186d3, role_id=701406944a8b457a80a0224b59207ce5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:10.957735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:10.985969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 150/289] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:10 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/users/378706ad92f34dc68a147c84d64186d3/roles/701406944a8b457a80a0224b59207ce5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:25:11.041653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:11.061065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a4a98-fc6f-404a-bc6d-5f780a89f36a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:11.115841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:11.116539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:11.116822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:11.117095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:11.117969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:11.118280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:11.119811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:11.130357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 140/290] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:11.138629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:11.221710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:11.268451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed9cd-ecd7-49fd-9b1c-3de58503c3a8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:11.310050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:11.311029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:11.311311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:11.311585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] PATH_INFO: `/v3/users/56e5a2ee7e664106a2ea511e67360897` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:11.312781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] RBAC: Authorizing `identity:get_user(user_id=56e5a2ee7e664106a2ea511e67360897)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:11.314316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:11.316267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 151/291] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:11 2022] GET /identity/v3/users/56e5a2ee7e664106a2ea511e67360897 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:11.322086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:11.440076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb842f-2148-4729-979d-bf6e243e5370 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:11.480310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:11.480892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:11.481175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:11.481484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:11.485017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:11.564336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:11.565896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:11.688160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 141/292] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:11.694682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:11.877916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f5b81-4223-48e4-8fb5-854b85e55094 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:11.913811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:11.929857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:11.930768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:11.931047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:11.931319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:11.932520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:11.933984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b014-c814-437a-820b-5b66908c8b6c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:11.935672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 152/293] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:11 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:11.942146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:12.002036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:12.095761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef20cc-a089-4d56-bd3d-5ee642945982 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:12.147376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:12.148367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:12.148824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:12.149295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:12.150319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=56e5a2ee7e664106a2ea511e67360897) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:12.150802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:12.152429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3680d-2de7-4600-9770-e9e329ad88da None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:12.158965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 142/294] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:11 2022] GET /identity/v3/role_assignments?user.id=56e5a2ee7e664106a2ea511e67360897&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=7df455d940c54f13b78a737b9c240982 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:12.743944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83f93-a8d8-4b4a-b56a-aa7dd558ae75 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:12.744486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83f93-a8d8-4b4a-b56a-aa7dd558ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:12.744486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c83f93-a8d8-4b4a-b56a-aa7dd558ae75 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:12.746107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 153/295] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:12.751783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:12.752185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:12.752391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:12.771508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:12.772709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:12.781223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ce22e-7b47-4ad7-98cb-52f522377d9a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:12.781493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ce22e-7b47-4ad7-98cb-52f522377d9a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:12.781773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ce22e-7b47-4ad7-98cb-52f522377d9a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:12.786047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 154/296] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:12.793657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:12.794227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:12.794642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:12.821763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:12.823326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:12.868757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 143/297] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:12.892637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:12.900291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 155/298] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:12.923404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:12.925899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:12.998622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f265ea0-1ba6-4956-a223-72091e34888d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.034768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f2a6d-a06a-4b4c-9b1f-a8aedc93360e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.035958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.036948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.037487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.037977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.048928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-aa06dbd6-263b-4239-96e0-7b77a2175941 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:13.057313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:13.058204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:13.058970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 144/299] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:13.060532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43515-10b7-4110-bbc6-6314539f6929 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.060532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43515-10b7-4110-bbc6-6314539f6929 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.060532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc43515-10b7-4110-bbc6-6314539f6929 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.062750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 145/300] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:13.063998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43515-10b7-4110-bbc6-6314539f6929 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.067248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.079516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.080345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.080594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.080871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.095102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c68fa914-34d1-41a0-910b-eb3509d87877 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:13.103162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:13.104025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:13.104790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:13.109478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 156/301] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:13.110686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.110973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.111249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.132983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:13.134210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:13.166200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.177871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc43515-10b7-4110-bbc6-6314539f6929 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.206100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 157/302] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:13.207160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.221670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.223553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.224014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.224822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.226109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:13.226593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.228834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.239791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 146/303] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:13.240811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.323701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d67096-bbda-43d1-82a5-34fda13e196c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.337595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.354433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2342b8-2719-462d-a27b-8003087dc0a0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.359754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.360427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.360706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.360979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.361763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:13.362066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.364174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.373961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 158/304] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:13.374757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.399999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.400790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.401071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.401386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.402551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.403977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.405617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 147/305] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:13.406369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.429575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.491569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928157-d223-4a34-b8c4-49487c59e347 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.511761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93aa1ec-e45c-4c23-baec-967c1b78d899 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.529814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.530697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.530979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.531251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] PATH_INFO: `/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.546482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] RBAC: Authorizing `identity:get_user(user_id=17bf75aa1d204ed0ab4a9bc2aa469d25)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.546660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.547477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.547756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.547952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.548046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] PATH_INFO: `/v3/users/844edc82ad7b4f1884b2a2f156865d07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.549222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] RBAC: Authorizing `identity:get_user(user_id=844edc82ad7b4f1884b2a2f156865d07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.549877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 159/306] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:13.551254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.557724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 148/307] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/users/844edc82ad7b4f1884b2a2f156865d07 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:13.557724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.557999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.589718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.651225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:13.661200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c484e28-8288-496c-8fe9-377ef277796c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.664840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66884-8f17-43ca-9d8d-017ead420c36 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.694168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.694836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.695117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.695393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] PATH_INFO: `/v3/groups` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.696084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.697546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f308d5-a9bd-4287-8ad4-c086cd577694 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.697664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.698226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.698507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.698783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.699601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, user.id=17bf75aa1d204ed0ab4a9bc2aa469d25, scope.system=all) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:13.699907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.701355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.707374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 149/308] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/role_assignments?user.id=17bf75aa1d204ed0ab4a9bc2aa469d25&scope.system=all&role.id=701406944a8b457a80a0224b59207ce5 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:13.708168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.718773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 160/309] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Jul 21 23:25:13 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:13.720156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2aef5-21a4-4987-a121-27ca3ffb04e1 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.720441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2aef5-21a4-4987-a121-27ca3ffb04e1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.720717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2aef5-21a4-4987-a121-27ca3ffb04e1 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.722581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 161/310] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:13.728622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.728907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.729300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.759959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:13.761346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:13.856816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eae91-9581-41e5-be29-d5fe987d25a1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:13.866546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 162/311] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:13.892166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:13.899818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:13.900692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:13.900969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:13.901406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] PATH_INFO: `/v3/system/users/844edc82ad7b4f1884b2a2f156865d07/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:13.902922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=844edc82ad7b4f1884b2a2f156865d07, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:13.904447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:13.917861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 150/312] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jul 21 23:25:13 2022] PUT /identity/v3/system/users/844edc82ad7b4f1884b2a2f156865d07/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:13.925689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:14.018641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea330-64cf-430e-9d96-5425a76fee24 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:14.059674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:14.060828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:14.061358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:14.061837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:14.073767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:14.083233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:14.084139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:14.084926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 163/313] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:14.092170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:14.120733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:14.206197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bd54-5b3f-4e58-a9b6-815e55303668 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:14.244211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:14.244882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:14.245163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:14.245474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:14.246223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:14.246527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:14.247906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:14.257289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 151/314] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:14.266329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:14.354341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:14.373410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a7d3-53a3-4eec-b735-a15b0bba8865 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:14.408852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:14.410071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:14.410313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:14.410592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] PATH_INFO: `/v3/users/378706ad92f34dc68a147c84d64186d3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:14.411937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] RBAC: Authorizing `identity:get_user(user_id=378706ad92f34dc68a147c84d64186d3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:14.413427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:14.415394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 164/315] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:14 2022] GET /identity/v3/users/378706ad92f34dc68a147c84d64186d3 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:14.422356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:14.507409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:14.531602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185939c-eefc-4e1f-9006-43d5669100f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:14.567284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:14.567951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:14.568296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:14.568582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:14.641323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:14.642800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:14.724157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:14.747735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 152/316] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:14.753340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:14.858349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9cbc1-bfa7-4625-aff2-976c88d9d8ee None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:14.893674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:14.894574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:14.894860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:14.895219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:14.896543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:14.898081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34bd6f-c285-41ec-8475-c86bb837925b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:14.900229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 165/317] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:14 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:14.906279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:15.015988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd04d-ee98-4a64-8553-7459ba4b6fb0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:15.053605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:15.054265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:15.054549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:15.054824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:15.055654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, scope.project.id=e6671723051b4569971cd3e5bc9c49b2, user.id=378706ad92f34dc68a147c84d64186d3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:15.055964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:15.057441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d54b2-3faa-449b-a0eb-34b104a6aceb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:15.064061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 153/318] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:14 2022] GET /identity/v3/role_assignments?user.id=378706ad92f34dc68a147c84d64186d3&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=701406944a8b457a80a0224b59207ce5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:15.826105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100ce7-46e8-4c2d-a701-8b0ccbf7bf25 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:15.826482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100ce7-46e8-4c2d-a701-8b0ccbf7bf25 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:15.826660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4100ce7-46e8-4c2d-a701-8b0ccbf7bf25 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:15.828181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 166/319] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:15.833771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:15.834060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:15.834334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:15.852196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:15.853428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:15.890908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:15.926479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 154/320] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:15.947703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076d38-ac8e-456e-b240-aa68312471c9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:15.948231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076d38-ac8e-456e-b240-aa68312471c9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:15.948231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076d38-ac8e-456e-b240-aa68312471c9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:15.950369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 167/321] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:15.951611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:15.956078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532b21-fbf4-46b9-ae6d-1266fb663fca None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:15.956375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532b21-fbf4-46b9-ae6d-1266fb663fca None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:15.957298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3532b21-fbf4-46b9-ae6d-1266fb663fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:15.976035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c3532b21-fbf4-46b9-ae6d-1266fb663fca None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:15.977257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c3532b21-fbf4-46b9-ae6d-1266fb663fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:15.991538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.054209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 168/322] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:16.055908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502b7b-823b-4ef6-8c9d-5bb386a89c33 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.056348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502b7b-823b-4ef6-8c9d-5bb386a89c33 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.056645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502b7b-823b-4ef6-8c9d-5bb386a89c33 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.057941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 169/323] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:16.065754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.066077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.066358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.068226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa3f8c-20d8-42f7-8452-96503c466b64 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.083937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:16.085081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:16.122421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.123225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.123504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.123776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.135188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:16.143582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:16.145137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:16.146430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 155/324] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:16.147333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.165007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 170/325] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:16.165904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.188554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.264912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.266128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545ef9-bef1-4dc0-bf31-b347475f6f7a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.288643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe35b-f9b1-41a3-b49c-653137374f34 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.310596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.311581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.311873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.312151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.313374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.314824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.316536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 156/326] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:16.320915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.324645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.325374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.325657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.325929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.326684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:16.326988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.328373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.337172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 171/327] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:16.337946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.439776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038dee5-15cb-4da9-8104-789208fb1471 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.444840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.448520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bfc7e-966a-4e7a-964d-3a8fbff03127 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.477508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.478185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.478466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.478743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] PATH_INFO: `/v3/groups` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.479428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.480852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.490635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.491473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.491738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.492017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.493213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.498809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 172/328] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Jul 21 23:25:16 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:16.509557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.509660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:16.517663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:16.518633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:16.519484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:16.520089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 157/329] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:16.526566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.646752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958484-2c69-4e81-b6f1-ccbada6d2868 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.649706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc7e99-c671-4d17-a1b6-5175c10b9dfc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.690010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.691807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.692170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.692446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] PATH_INFO: `/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.693743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] RBAC: Authorizing `identity:get_user(user_id=17bf75aa1d204ed0ab4a9bc2aa469d25)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.695626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.696643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.697537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 173/330] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:16.698690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.698993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.699273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.700038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:16.700343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.701786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.703174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.718996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 158/331] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:16.727107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:16.765929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.801893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:16.843829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7232-5f25-486b-87ff-0d06c9a10cfe None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.862601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee3c95-9141-4e70-b527-45a081fa12fc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:16.888407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.889313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.889594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.889870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] PATH_INFO: `/v3/system/users/17bf75aa1d204ed0ab4a9bc2aa469d25/roles/701406944a8b457a80a0224b59207ce5` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.892281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=17bf75aa1d204ed0ab4a9bc2aa469d25, role_id=701406944a8b457a80a0224b59207ce5)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.893754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.903300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:16.904123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:16.904489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:16.904776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] PATH_INFO: `/v3/users/844edc82ad7b4f1884b2a2f156865d07` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:16.906065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=844edc82ad7b4f1884b2a2f156865d07)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:16.907590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288475d-6104-4bb4-baef-0610041eb6a7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:16.908484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 174/332] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jul 21 23:25:16 2022] PUT /identity/v3/system/users/17bf75aa1d204ed0ab4a9bc2aa469d25/roles/701406944a8b457a80a0224b59207ce5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:25:16.909535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 159/333] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/users/844edc82ad7b4f1884b2a2f156865d07 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:16.919836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:17.055017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ec045-90e3-4f75-8bfc-cb2f0516e7d0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:17.088894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:17.093977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:17.095159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:17.095813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:17.096647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:17.098109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] RBAC: Adding query filter params (role.id=7df455d940c54f13b78a737b9c240982, user.id=844edc82ad7b4f1884b2a2f156865d07, scope.system=all) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:17.098736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:17.102336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb351b-d3f9-4e49-9c5f-9508672d9500 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:17.116992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 175/334] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 23:25:16 2022] GET /identity/v3/role_assignments?user.id=844edc82ad7b4f1884b2a2f156865d07&scope.system=all&role.id=7df455d940c54f13b78a737b9c240982 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:18.805479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cb6-d7b5-408b-baac-2db2901f0657 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:18.805995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cb6-d7b5-408b-baac-2db2901f0657 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:18.806103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d609cb6-d7b5-408b-baac-2db2901f0657 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:18.807749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 160/335] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:18.819183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:18.819652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:18.819727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:18.842174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:18.843390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:18.923934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 176/336] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:18.960616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d609cb6-d7b5-408b-baac-2db2901f0657 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.102279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:19.111850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d609cb6-d7b5-408b-baac-2db2901f0657 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:19.164767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:19.165602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.165886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.166161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.182807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f7952b59-de6f-42ba-b289-7ae38a593ea6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:19.190650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:19.192080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:19.193412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 161/337] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:19.200399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.312946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1853b-da09-43ac-9030-07b5f124d892 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.313316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1853b-da09-43ac-9030-07b5f124d892 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.313529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1853b-da09-43ac-9030-07b5f124d892 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.314906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 162/338] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:19.320883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.321503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.321980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.323140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be611-f239-41cb-9688-69441f0c7432 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:19.353653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:19.361091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:19.362752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:19.372262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:19.374127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.374556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.374972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.375895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:19.376339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:19.377907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:19.388901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 177/339] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:19.395937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.530810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 163/340] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:19.546504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bccb4-9afb-46b5-9d4a-fe0b3f2d5079 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:19.570322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.593895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:19.594800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.595228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.595707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.681666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:19.699284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:19.700820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:19.723556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:19.758886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce96e0e-005a-4a33-ae5c-f36e5760441c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:19.827257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:19.828841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:19.829367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:19.829974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:19.847734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 178/341] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:19.853900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.854373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:19.863379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:19.864302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:19.865092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:19.867560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 164/342] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:19.873260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:19.974819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.001498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b886c8-9281-4b3f-9bef-d6f6ac62af7c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.053619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.054499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.054783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.055057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.061759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.063239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.065322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 179/343] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:19 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:20.071491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.089282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7a46-d67a-44d9-ad38-58e3023019f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.165724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.166790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.167300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.167775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.168718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:20.169245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.170825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c0519-3b40-401f-a9bd-33ef75978ca9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.184177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 165/344] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:20.185789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd6c-d8b1-4ee9-9ade-4a37560e1cfe None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.186291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd6c-d8b1-4ee9-9ade-4a37560e1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.186787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944fd6c-d8b1-4ee9-9ade-4a37560e1cfe None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.188475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 166/345] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:20.193083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944fd6c-d8b1-4ee9-9ade-4a37560e1cfe None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.197251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.208463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7581-8e69-4879-8778-a798ee1b87d8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.249430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.250300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.250578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.250849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.267106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.268810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9420-192e-4dad-a0d0-2134e944a0b0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.272492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 180/346] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:20.274355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.274661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.274936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.318511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:20.319932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:20.344668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.387804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944fd6c-d8b1-4ee9-9ade-4a37560e1cfe None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.428520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.429534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.429962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.430381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.437221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 181/347] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:20.437221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.530016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.531764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7948fd1-f7f8-45e8-ad53-f5f0307f97f1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.533876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.543251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b848a-c961-4038-a3ba-c6bc5f1cef95 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.582131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.583159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.583587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.584007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.585018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=1518a0750d864e4dae2087c9d5e01396) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:20.585502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.587120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649f544-259c-4876-83a1-2f6989661e4a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.593788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 182/348] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=7df455d940c54f13b78a737b9c240982 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:20.595310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627b23-378a-4723-bac6-30ff50ededd6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.595803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627b23-378a-4723-bac6-30ff50ededd6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.596258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627b23-378a-4723-bac6-30ff50ededd6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.597879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 183/349] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:20.599332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627b23-378a-4723-bac6-30ff50ededd6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.614981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.653535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 167/350] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:20.655195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.655623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.656039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.677097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:20.678551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:20.723207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627b23-378a-4723-bac6-30ff50ededd6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.757471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 168/351] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:20.758780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.766662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.767637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.768026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.773789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.790480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:20.801686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:20.806903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:20.810938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:20.812050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 184/352] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:20.817256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.889635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f6809-176f-43f7-9a1c-802e74e2a5cc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.894630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:20.933267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.934398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.934860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.935306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.935779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee9e3-e8da-4f3a-b8b1-5da766ff7096 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:20.936875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:20.938858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:20.941077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 169/353] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:20.942063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:20.973630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:20.974540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:20.974896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:20.975250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:20.986832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:20.995720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:20.996674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:20.997514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 185/354] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:21.004048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.056971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.060538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad607e06-a2c6-409f-a726-1330a73d0feb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.100801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.102023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.102507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.102976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.103982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:21.104534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.106150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.117005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 170/355] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.117509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099499b-d5d0-40b0-b912-d8523af147ce None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.122084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.152198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.161134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.162050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.162334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.162613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.163811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.166638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.168672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 186/356] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:20 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.169507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.263524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8583d4-42db-433a-8a4f-553d8d459d6c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.281989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0df60e-b423-4fba-9c78-10bdbf5d879b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.315142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.316458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.316768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.317023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.318144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:21.318460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.320116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa13c0-ae3c-4d30-8a63-223cfc740283 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.323044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.323925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.324202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.324500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] PATH_INFO: `/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.326632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] RBAC: Authorizing `identity:get_user(user_id=17bf75aa1d204ed0ab4a9bc2aa469d25)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.328080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.328937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 171/357] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.330015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 187/358] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/users/17bf75aa1d204ed0ab4a9bc2aa469d25 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.330390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5458ca-1480-422e-936b-8291f57d46a5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.330680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5458ca-1480-422e-936b-8291f57d46a5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.330790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.330957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5458ca-1480-422e-936b-8291f57d46a5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.332587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 172/359] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:21.333703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32e4b-c6da-463f-9203-3177c1164824 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.333989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32e4b-c6da-463f-9203-3177c1164824 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.334248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32e4b-c6da-463f-9203-3177c1164824 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.335706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 173/360] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:21.336614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d32e4b-c6da-463f-9203-3177c1164824 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.374460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.423212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.476188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d32e4b-c6da-463f-9203-3177c1164824 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.479981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304372b-5253-4c48-a621-09d3e426822d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.525834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.526573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.526919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.527258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.531618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.532369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.532652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.532933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.533851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=1518a0750d864e4dae2087c9d5e01396) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:21.534217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.536253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.544732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 188/361] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.545610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.638388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.639836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f3eac-c329-4957-9c18-dc2e9514cddf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.672818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.685491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db0360-7554-440a-a9fb-11e32ac23785 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:21.723455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.738849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:21.739045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.739281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.739486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.740355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] RBAC: Adding query filter params (role.id=701406944a8b457a80a0224b59207ce5, user.id=17bf75aa1d204ed0ab4a9bc2aa469d25, scope.system=all) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:21.741296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:21.742118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670b40-13b6-493a-b235-8827a46408a3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:21.758320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 189/362] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/role_assignments?user.id=17bf75aa1d204ed0ab4a9bc2aa469d25&scope.system=all&role.id=701406944a8b457a80a0224b59207ce5 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:21.760014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.760505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.760979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.779282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 174/363] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:21.780296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:21.780802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:21.781097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:21.781416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:21.782477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:21.799509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:21.801311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:21.860935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 190/364] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:21.862151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.886841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 175/365] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:21.904842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:21.968572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:21.988209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b5e7-4706-44d0-a45e-b059c94bb3a2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.008659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.017120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26085300-2ef1-4401-b186-d841cd47c2d7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.027669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.028553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.028837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.029111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.031100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.032564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.034373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 191/366] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.035220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.054622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.055435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.055712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.055990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.067741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:22.075951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:22.076878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:22.077721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:22.081859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 176/367] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:22.082762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.150543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dca0c-c509-4c30-8eab-3221d30cf302 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.188931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.190242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.191141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.191705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.202299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c431a5-3a9b-4978-9818-0c9ebd9e8006 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.204263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:22.214477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:22.215363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:22.216145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:22.217466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.219659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 192/368] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:22.220662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.244084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.245118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.245845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.246084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.247720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.249166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.250822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 177/369] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.251659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.284362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.364334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c77237-a127-4583-b896-d78a3de37bd8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.380780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d07e08-8c25-4b37-b4ee-07f87a67dbe4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.404861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.405644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.405986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.406328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.407498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:22.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.410989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.419246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 193/370] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.422539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.423464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.423958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.424297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.424687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.425742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:22.426267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.428163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.438499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 178/371] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.439732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.494194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.528410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaedb39-b376-45f0-ab48-f26ba33dee10 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.560274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c42173-69dc-48b2-a3f1-e8bba034f0ad None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.560931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.565517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.566413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.566693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.566972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.567809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=e6671723051b4569971cd3e5bc9c49b2) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:22.568122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.570318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.576591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 194/372] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=7df455d940c54f13b78a737b9c240982 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.577500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.600377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.601057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.601480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.601757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.680947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.682572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.697215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886570-0608-48d4-a7dc-6a588e28b3da None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.733088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.739434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.740098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.740374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.740637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.787830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:22.797939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 179/373] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:22.805132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.820632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.822239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.919311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf5c1-46ab-4992-bb60-3ebe1a82eb64 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:22.931430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 195/374] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:22.937011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.969640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:22.970432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:22.970712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:22.971087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:22.972436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:22.973922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:22.975937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 180/375] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:22.981338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:22.997775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:23.016448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:23.069862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d4463-b909-45b7-8b52-83ec7ec46dcd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.096684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bc364-c738-4b90-89f2-c4a773dd101e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.139726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.140599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.140884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.141161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.142715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:23.144941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.145837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.146115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.146388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] PATH_INFO: `/v3/projects/853ebd43a36d473dbecd2e6330bf3136` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.147550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:23.149404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 181/376] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:23.149900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] RBAC: Authorizing `identity:get_project(project_id=853ebd43a36d473dbecd2e6330bf3136)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:23.151331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:23.157612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 196/377] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:22 2022] GET /identity/v3/projects/853ebd43a36d473dbecd2e6330bf3136 => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:23.162841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:23.166731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:23.327331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:23.335085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7dc5-7def-47aa-adc4-8670682af54b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.379320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c860fa-bd7c-488a-b84a-ebd3cea45a60 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.381782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.382656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.382942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.383212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] PATH_INFO: `/v3/groups/6ac7177bf5ce470ebef961b864afd670` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.395850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] RBAC: Authorizing `identity:get_group(group_id=6ac7177bf5ce470ebef961b864afd670)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:23.397336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:23.399065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 197/378] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:23 2022] GET /identity/v3/groups/6ac7177bf5ce470ebef961b864afd670 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:23.406996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:23.411266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:23.440353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.441569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.441848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.442120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.442955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=e6671723051b4569971cd3e5bc9c49b2) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:23.443260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:23.444695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0958fb-b7de-4a55-b0df-8f0c747675ba None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:23.457581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 182/379] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:23 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 260 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:23.505845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c40e76-a26c-409d-9050-56bbb83282c5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.506162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c40e76-a26c-409d-9050-56bbb83282c5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.506404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c40e76-a26c-409d-9050-56bbb83282c5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.508874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 183/380] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:23.519352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.519697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.519900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.558473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:23.559688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:23.561162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80652e0a-453b-4ed5-88f4-5de7efcfe906 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.609491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.612232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.613468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.615211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.616316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] RBAC: Adding query filter params (group.id=6ac7177bf5ce470ebef961b864afd670, role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=853ebd43a36d473dbecd2e6330bf3136) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:23.617706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:23.620493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:23.636788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 198/381] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:23 2022] GET /identity/v3/role_assignments?group.id=6ac7177bf5ce470ebef961b864afd670&scope.project.id=853ebd43a36d473dbecd2e6330bf3136&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:23.683702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 184/382] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:23.720767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:23.800811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:23.846056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd435ce-d82f-4ed6-b309-70da7100553d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:23.886525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:23.887954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:23.888445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:23.888973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:23.902818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:23.911977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:23.912973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:23.913885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:23.916764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 199/383] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:23.922446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.019477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:24.049029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900a92d-b24f-4178-8a6e-bd8a5f2706c8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.097969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.098666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.098952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.099226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.099990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:24.100292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:24.101718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdb2ac-9bc4-4f0f-ae29-d5d03e7f52ee None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:24.111232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 185/384] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:24.117661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.251036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552e057-0b57-4ad4-bdaf-57bf444f0495 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.282417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:24.283732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ba37-6df5-4e35-8708-0c5b3df4442d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.284027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ba37-6df5-4e35-8708-0c5b3df4442d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.284337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ba37-6df5-4e35-8708-0c5b3df4442d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.286620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 186/385] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:24.292132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc809ab-2791-4292-804f-404530c215e0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.292428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc809ab-2791-4292-804f-404530c215e0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.292711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc809ab-2791-4292-804f-404530c215e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.296311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.297205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.297495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.297766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.298970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:24.300484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:24.302493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 200/386] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:24 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:24.308483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.312481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-afc809ab-2791-4292-804f-404530c215e0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:24.313722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afc809ab-2791-4292-804f-404530c215e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:24.395854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 187/387] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:24.422302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc809ab-2791-4292-804f-404530c215e0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.504004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:24.535916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec43a18-38aa-467e-b648-3d341c3ac79e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.555448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc809ab-2791-4292-804f-404530c215e0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.604635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.606311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.606596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.606875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.608659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:24.610128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:24.613482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 201/388] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:24 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:24.618753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.624898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.625737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.626022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.626299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.653394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:24.673912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:24.674849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:24.676262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 188/389] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:24.700193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:24.735150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:24.783145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8e394-32ee-4d8c-ab8d-801b0a7a4d0d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.826334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.827229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.827512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.827789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.832797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, group_id=db2fcffed87c457abdb6a19dcd1f017b, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:24.834302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:24.865664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 202/390] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 23:25:24 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:24.895359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85308b-cfff-4fb7-89d8-d7c8076fc0f0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:24.929655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:24.936704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:24.937427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:24.938126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:24.938770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:24.939539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:24.940311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:24.942329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:24.957311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 189/391] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:24.963131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:25.108954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d5ca-45e8-473d-9d2f-daf5f7f90832 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:25.145171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:25.155011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:25.156021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.156367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.156991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.162863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:25.170532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:25.172577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 203/392] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:24 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:25.177931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:25.328862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804a350-a694-4c61-8576-a20791ada205 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:25.374908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:25.375712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.375999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.376279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.377534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:25.379603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b76a6-c93f-42e3-8779-7edd45333a8b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:25.381679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 190/393] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:25 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:25.387627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:25.536129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d441f-c3cf-4bdc-b35a-cb4c8d809f1f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:25.582914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:25.584181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.584655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.585117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.589384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1518a0750d864e4dae2087c9d5e01396, group_id=db2fcffed87c457abdb6a19dcd1f017b, role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:25.591028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db263d-dad0-46da-bc6b-0e2353ffd2b4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:25.630350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 204/394] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 23:25:25 2022] PUT /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:25.646116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f69b9-9d7d-4701-959d-ae040ffc72ab None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.646449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f69b9-9d7d-4701-959d-ae040ffc72ab None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.646730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f69b9-9d7d-4701-959d-ae040ffc72ab None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.648371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 191/395] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:25.654059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.654374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.654646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.679568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:25.681212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:25.751921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:25.780464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 205/396] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:25.819100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f69b9-9d7d-4701-959d-ae040ffc72ab None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:25.888343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:25.937568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f69b9-9d7d-4701-959d-ae040ffc72ab None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:25.978362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:25.979485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:25.979902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:25.980306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:25.999446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:26.007670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:26.008646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:26.009476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 192/397] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:26.015389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.131578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4227c-8edc-49ca-b432-506df2decf31 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:26.170684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:26.171287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.171563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.171841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.172596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] RBAC: Adding query filter params (name=member) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:26.172901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:26.174304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:26.184143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 206/398] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:26.189676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.304362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1efa2-3bd3-4970-b3cf-e1c497a16cdb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:26.328758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:26.348223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:26.349095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.349403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.349680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.350861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:26.352317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81fcf1-2c52-477d-8a08-1c070f32827a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:26.354393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 193/399] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:26.359880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.409877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:26.477460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de19a1-58a0-4869-b210-055c2ba5766f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:26.519848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51683-c388-4310-ad12-15cb03475e40 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.520173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51683-c388-4310-ad12-15cb03475e40 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.520415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51683-c388-4310-ad12-15cb03475e40 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.521876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 194/400] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:26.522600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:26.523487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.523764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.524035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.525400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:26.526885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:26.527578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30427b7-b54b-442b-a6b6-37e0ea2630b5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.527875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30427b7-b54b-442b-a6b6-37e0ea2630b5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.528159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30427b7-b54b-442b-a6b6-37e0ea2630b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.528653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 207/401] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:26.535223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.563778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a30427b7-b54b-442b-a6b6-37e0ea2630b5 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:26.565051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a30427b7-b54b-442b-a6b6-37e0ea2630b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:26.650960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 195/402] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:26.653061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4197-1372-4cf5-9ab5-90dcf32bbaf3 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.653580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4197-1372-4cf5-9ab5-90dcf32bbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.654078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4197-1372-4cf5-9ab5-90dcf32bbaf3 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.655594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 196/403] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:26.666716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.667291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.667790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.697838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:26.699016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:26.716105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1bfc3-c408-4698-843f-66539584c737 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:26.727408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:26.752776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:26.754340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.754622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.754896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.757281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, group_id=db2fcffed87c457abdb6a19dcd1f017b, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:26.759362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:26.780656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 208/404] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 23:25:26 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:25:26.782223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.789610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 197/405] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:26.817435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:26.912426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c510430-a953-4ac2-8f94-c6038d893a30 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:26.919423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:26.955174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:26.956934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:26.957479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:26.957944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:26.970402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:26.978743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:26.979660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:26.980443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:26.983070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 209/406] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:26.996979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.050082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db98fd4-2224-4ecd-a36d-3cd928fa36dc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.059128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:27.102676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.103818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.104288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.104749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.127323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:27.139067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:27.139982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:27.140750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:27.147765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 198/407] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:27.149942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.194179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179cbb-1ef0-4c23-a29e-1a4d6d31fa70 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.256263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.256983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.257298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.258860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.260351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:27.261268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.265358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.284220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 210/408] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:27.291098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.334719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403efb3-22fa-490a-9039-ff74692428c1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.348989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:27.407850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.408531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.408814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.409089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.410306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:27.411230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.414152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.435549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 199/409] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:27.441948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.581932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee20f37-4fb0-4b3a-ae13-3cd0a1eb66c1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.595893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:27.617208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcfe96-401a-4ffb-b95a-c8d6c5b3ad55 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.640997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.641901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.642188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.642477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.644344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.645830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.649952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 200/410] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:27 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:27.653614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.691220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.692098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.692386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.692668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] PATH_INFO: `/v3/groups/6ac7177bf5ce470ebef961b864afd670` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.693984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] RBAC: Authorizing `identity:get_group(group_id=6ac7177bf5ce470ebef961b864afd670)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.695425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11cb42-60fb-4a16-918d-371726b73b2d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.697268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 211/411] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:27 2022] GET /identity/v3/groups/6ac7177bf5ce470ebef961b864afd670 => generated 229 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:27.698260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ff7e9-f582-49a9-9c42-e89f76d9fc88 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.698543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ff7e9-f582-49a9-9c42-e89f76d9fc88 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.698816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ff7e9-f582-49a9-9c42-e89f76d9fc88 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.700282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 212/412] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:27.704646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ff7e9-f582-49a9-9c42-e89f76d9fc88 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:27.720664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:27.796012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792ed5-ed4f-48f7-a657-f616c64c8124 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.838188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.839331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.839925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.842074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.844203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.846938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c501-62a3-400a-b78d-a9cebb80f9b1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.851760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 201/413] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:27 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:27.854046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.859393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.859858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.884537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:27.887076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:27.910161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ff7e9-f582-49a9-9c42-e89f76d9fc88 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:27.983436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:27.984328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:27.984611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:27.984909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] PATH_INFO: `/v3/projects/853ebd43a36d473dbecd2e6330bf3136` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:27.986319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] RBAC: Authorizing `identity:get_project(project_id=853ebd43a36d473dbecd2e6330bf3136)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:27.988513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:27.990610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 213/414] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:27 2022] GET /identity/v3/projects/853ebd43a36d473dbecd2e6330bf3136 => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:27.995237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.014162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 202/415] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:28.015193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.029373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.047951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.120820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851a00-678f-4ec3-8f82-7c6f89ef42f5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.136098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c796ee1-352f-4429-bf4d-84954be4a0be None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.159984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.161295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.161795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.162288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.164778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6671723051b4569971cd3e5bc9c49b2, group_id=db2fcffed87c457abdb6a19dcd1f017b, role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:28.166467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:28.181388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.182500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.182789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.183112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] PATH_INFO: `/v3/projects/853ebd43a36d473dbecd2e6330bf3136/groups/6ac7177bf5ce470ebef961b864afd670/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.183806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 214/416] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 23:25:27 2022] PUT /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2/groups/db2fcffed87c457abdb6a19dcd1f017b/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:28.184898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.185312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=853ebd43a36d473dbecd2e6330bf3136, group_id=6ac7177bf5ce470ebef961b864afd670, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:28.186918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:28.208324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 203/417] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 23:25:28 2022] PUT /identity/v3/projects/853ebd43a36d473dbecd2e6330bf3136/groups/6ac7177bf5ce470ebef961b864afd670/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:28.302852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.317545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a53fc-d155-456a-a8bd-bc4f849ca1b8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.361902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.363208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.363491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.363768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.384401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7ccd09d7-1fe6-4207-8a01-d0d558a4b6e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:28.392889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:28.394608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:28.395401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:28.398469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 215/418] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:28.404684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.445852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54582-b651-495c-921e-8248cb2cb550 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.446156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54582-b651-495c-921e-8248cb2cb550 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.446414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54582-b651-495c-921e-8248cb2cb550 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.447800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 216/419] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:28.454433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.454716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.454988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.481563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:28.482878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:28.524010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.533356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6638d2-873d-4379-a7b7-61a2981b5a45 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.561400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 217/420] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:28.570611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.571295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.571587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.571872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.572627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:28.572937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:28.574419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:28.583873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 204/421] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:28.588644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.589297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.674035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.697388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9858d2-abf8-4a03-a778-a04bae7b948c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.702350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d605219-220a-4e35-9606-a4dc04b9eaf4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.733159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.734161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.734540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.734910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.739731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.740397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.740692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.740975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.746720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:28.755383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:28.756303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:28.757606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 218/422] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:28.763049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.769733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.817037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:28.818562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:28.868631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed90c6-83f1-4bfb-8899-61a008c02894 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:28.915456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:28.916127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:28.916407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:28.916679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:28.917471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:28.917777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:28.919177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:28.927927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 219/423] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:28.928465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:28.928566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 205/424] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 23:25:28.933290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:28.938658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.046919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f984c-9e4a-4606-9a51-542f1d0171f0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.082813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.083482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.083771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.084099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.098633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.157395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.158924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.167368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.215414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9a04-4956-4ffd-880d-4e0caadc98ed None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.266440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 220/425] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:29.274212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.306664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.307576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.307860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.308134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.310943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.312387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.315811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 206/426] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:28 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:29.320901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.430086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2853-4f89-414d-b3f7-ac1d7e39c075 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.433497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.468363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251151af-ecef-449f-9943-888ee42a560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.469283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251151af-ecef-449f-9943-888ee42a560b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.469675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251151af-ecef-449f-9943-888ee42a560b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.469950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251151af-ecef-449f-9943-888ee42a560b None admin] PATH_INFO: `/v3/projects/1518a0750d864e4dae2087c9d5e01396` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.471141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251151af-ecef-449f-9943-888ee42a560b None admin] RBAC: Authorizing `identity:get_project(project_id=1518a0750d864e4dae2087c9d5e01396)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.472813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251151af-ecef-449f-9943-888ee42a560b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.475097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 221/427] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/projects/1518a0750d864e4dae2087c9d5e01396 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:29.480856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ebb6-2d1d-459b-bbca-e519d5274a0b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.481142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ebb6-2d1d-459b-bbca-e519d5274a0b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.481626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965ebb6-2d1d-459b-bbca-e519d5274a0b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.483398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 222/428] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:29.488243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ebb6-2d1d-459b-bbca-e519d5274a0b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.491833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9b570-2fad-49b8-a4c8-1b8a5ef6e8eb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.516642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.530777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.531776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.532131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.532479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.533944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.535634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bf62a-d00c-4388-a034-d5dd5089f219 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.537953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 207/429] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:29.539448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.539801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.540141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.558714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:29.560097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:29.599886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965ebb6-2d1d-459b-bbca-e519d5274a0b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.640573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.641760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.642045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.642321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.644090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.645632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.646221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 208/430] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:29.647226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.647616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 223/431] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:29.654919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.703519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.777326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2648-73b0-4821-8db6-26abff2cd14d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.799487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907a6d-ae06-4ca7-bda2-d522ef241344 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.812988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.813857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.814232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.814609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.815570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=1518a0750d864e4dae2087c9d5e01396) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:29.815980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.817588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.824160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 224/432] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:29.825149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:29.826686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.844542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.845447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.845823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.846190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:29.847754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=1518a0750d864e4dae2087c9d5e01396) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:29.848167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:29.849844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:29.857081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 209/433] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=1518a0750d864e4dae2087c9d5e01396&role.id=7df455d940c54f13b78a737b9c240982 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:29.953928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:29.957985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa41f-3590-4b70-8c46-e696d4df66b8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:29.999270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:29.999513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:29.999591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:29.999864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.012912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:30.021686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:30.022634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:30.023444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 225/434] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:30.029169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.147492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4863cb-a4b1-4f45-934c-f16b0a7a8c69 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:30.185746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:30.186421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.186703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.186982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.187732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:30.188037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:30.189459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:30.198013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 210/435] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:30.203668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.319076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c93018-b9aa-4af2-8c30-fad41388b45d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:30.359284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:30.359921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.360199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.360467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.391508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:30.435031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:30.436499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae10beb-9703-417a-a639-11334f8eedbf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:30.547067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 226/436] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:30.553312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.605646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3418-8d96-43c2-aef3-7d2c84948175 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.605962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3418-8d96-43c2-aef3-7d2c84948175 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.606139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3418-8d96-43c2-aef3-7d2c84948175 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.607841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 227/437] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:30.609513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:30.616205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.616772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.617305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.637867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:30.639066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:30.672162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdfeb5-ef05-4ae9-bf4a-db21371be3d0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:30.702446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:30.711421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:30.712290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.712568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.712839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.714080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:30.715490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 228/438] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:30.715617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:30.717400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 211/439] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:30.726685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.738781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.833612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4abb3-7944-49b8-b991-b2096a099e2f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:30.846340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c8617-b70c-44d7-8a88-801f3ed7785c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:30.862029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:30.871734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:30.872584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.872870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.873141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.874334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:30.875785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:30.877671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 229/440] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:30.883592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.883939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:30.884734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.885018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.885325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.897710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-131520b8-a76a-47e9-bf2b-3f4d2d0e0c64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:30.905394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:30.906304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:30.907107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 212/441] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:30.908477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b62556-f760-4ee9-b0a5-7d50fe36e578 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:30.908477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b62556-f760-4ee9-b0a5-7d50fe36e578 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:30.908477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b62556-f760-4ee9-b0a5-7d50fe36e578 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:30.909708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 213/442] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:30.914038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b62556-f760-4ee9-b0a5-7d50fe36e578 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:30.947495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:30.991190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d15f1d-bb33-4104-9935-829ba8889f2d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.020538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b62556-f760-4ee9-b0a5-7d50fe36e578 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.024889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.025577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.025862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.026138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.026964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=7df455d940c54f13b78a737b9c240982, scope.project.id=e6671723051b4569971cd3e5bc9c49b2) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:31.027284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.028712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b3bd4-ba19-41a0-ac41-4f5ca5dd0f56 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.034659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 230/443] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=7df455d940c54f13b78a737b9c240982 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:31.035697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.035985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.036264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.059135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:31.060479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:31.062180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.062875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.063161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.063442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.064209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:31.064516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.066793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.083067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 214/444] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:31.084289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.132571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.145597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 231/445] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:31.168998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.208083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b786f61-5bf5-4bad-bae1-3077ea4308dd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.231726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.256588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.257549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.258072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.258556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.292303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4f540-f5a4-4484-9037-625d33d38a62 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.336730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.337671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.337951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.338220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.347149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.348714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.349978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:31.358139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:31.359081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:31.360021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 232/446] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:31.367467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.391137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.460111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 215/447] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:31.465710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.477803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae4a1-6f90-4a3c-818c-d0ab4dfb31ce None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.491029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.513456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.514125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.514408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.514687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.515438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:31.515746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.517120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.525091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 233/448] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:31.530993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.563541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb836a-0370-4eeb-872a-e66d3f8c263b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.597912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.598750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.599659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.599659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] PATH_INFO: `/v3/projects/853ebd43a36d473dbecd2e6330bf3136` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.600536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=853ebd43a36d473dbecd2e6330bf3136)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.602103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.603785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 216/449] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/projects/853ebd43a36d473dbecd2e6330bf3136 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:31.609268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.614428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.630372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f669e27-c4ed-40ec-9201-da3f24d46c7b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.663155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.663730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.664010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.664279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.708269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.711330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb581f09-abef-4828-8fe4-d6e7a6b0d4c5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.733783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.735249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.745081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.745956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.746234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.746503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] PATH_INFO: `/v3/groups/6ac7177bf5ce470ebef961b864afd670` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.747656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] RBAC: Authorizing `identity:get_group(group_id=6ac7177bf5ce470ebef961b864afd670)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.749081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.750907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 217/450] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/groups/6ac7177bf5ce470ebef961b864afd670 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:31.756637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.825597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.837361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 234/451] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 23:25:31.842841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:31.855972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6012ca-661d-49b4-8e10-c43316c615d8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.890020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.890670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.890950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.891223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.892051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] RBAC: Adding query filter params (group.id=6ac7177bf5ce470ebef961b864afd670, role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=853ebd43a36d473dbecd2e6330bf3136) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:31.892364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.894418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.906151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 218/452] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/role_assignments?group.id=6ac7177bf5ce470ebef961b864afd670&scope.project.id=853ebd43a36d473dbecd2e6330bf3136&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:31.919018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:31.946814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eeaeb-011a-4570-9378-0a3f1f69363e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:31.984034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:31.984942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:31.985221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:31.985491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] PATH_INFO: `/v3/projects/e6671723051b4569971cd3e5bc9c49b2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:31.986771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] RBAC: Authorizing `identity:get_project(project_id=e6671723051b4569971cd3e5bc9c49b2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:31.988990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:31.990969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 235/453] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/projects/e6671723051b4569971cd3e5bc9c49b2 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:31.996760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:32.102974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ab34c-9685-47dd-a3ca-3f3712ded063 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:32.136945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:32.138092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:32.138375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:32.138652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] PATH_INFO: `/v3/groups/db2fcffed87c457abdb6a19dcd1f017b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:32.139803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] RBAC: Authorizing `identity:get_group(group_id=db2fcffed87c457abdb6a19dcd1f017b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:32.141267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb5491-3dd4-4013-b5b3-5e3dc515f167 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:32.142884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 219/454] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 23:25:31 2022] GET /identity/v3/groups/db2fcffed87c457abdb6a19dcd1f017b => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:32.148667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:32.245028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a12dc-b6af-4002-a22f-7495f97a05e9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:32.278162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:32.278805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:32.279088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:32.279365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:32.280186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] RBAC: Adding query filter params (group.id=db2fcffed87c457abdb6a19dcd1f017b, role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=e6671723051b4569971cd3e5bc9c49b2) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:32.280497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:32.281949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274acf45-585f-4072-b59b-7d2c577fd3cd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:32.288244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 236/455] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 23:25:32 2022] GET /identity/v3/role_assignments?group.id=db2fcffed87c457abdb6a19dcd1f017b&scope.project.id=e6671723051b4569971cd3e5bc9c49b2&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:35.011233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af281-48e8-41a6-a110-e1796848c75c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.011752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af281-48e8-41a6-a110-e1796848c75c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.011826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857af281-48e8-41a6-a110-e1796848c75c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.013714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 220/456] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:35.019460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee780a-fec9-442f-9ec7-3e9e747e8827 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.019939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee780a-fec9-442f-9ec7-3e9e747e8827 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.020014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee780a-fec9-442f-9ec7-3e9e747e8827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.033647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.040249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-31ee780a-fec9-442f-9ec7-3e9e747e8827 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:35.041466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-31ee780a-fec9-442f-9ec7-3e9e747e8827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:35.149378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 237/457] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:35.187430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60844e-8675-4fe4-9e7f-5c06dbcd5132 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.187726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60844e-8675-4fe4-9e7f-5c06dbcd5132 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.187984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60844e-8675-4fe4-9e7f-5c06dbcd5132 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.189823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 221/458] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:35.195590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60844e-8675-4fe4-9e7f-5c06dbcd5132 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.196846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bcd6c-7ad9-48f3-a5f9-e56a14aef7aa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.197378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bcd6c-7ad9-48f3-a5f9-e56a14aef7aa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.197849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bcd6c-7ad9-48f3-a5f9-e56a14aef7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.199850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.228485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b53bcd6c-7ad9-48f3-a5f9-e56a14aef7aa None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:35.232684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b53bcd6c-7ad9-48f3-a5f9-e56a14aef7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:35.318815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 238/459] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:35.320248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c0e-8b99-4e1b-aee7-cf78bb21f662 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.320531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c0e-8b99-4e1b-aee7-cf78bb21f662 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.321061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863c0e-8b99-4e1b-aee7-cf78bb21f662 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.326701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 239/460] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:35.328065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.328604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.329075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.345732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60844e-8675-4fe4-9e7f-5c06dbcd5132 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.351102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:35.352553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:35.381517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.382550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.382994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.383401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.394743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.396381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:35.414950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:35.415969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:35.416814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:35.416814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:35.416814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.416814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:35.418612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 222/461] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:35.419550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.426469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.436317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 240/462] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:35.437493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.500808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.550481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de65ae-05eb-4b29-a83b-422e6cd2b9c0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.557495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fc80e-51a9-481d-81b1-03f7d2281f8d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.586253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.586962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.587245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.587511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.594384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.595049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.595440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.595721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.597093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:35.597631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.598753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35eaa2-e555-4f9e-bdfa-4438238896a5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.598868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.600196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.617223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 241/463] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:35.618472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:35.619693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 223/464] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:35.620664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.621912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd64e-4c73-4db3-8c11-1654ece1302d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.622340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd64e-4c73-4db3-8c11-1654ece1302d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.622774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd64e-4c73-4db3-8c11-1654ece1302d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.624949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 242/465] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:35.626232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd64e-4c73-4db3-8c11-1654ece1302d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.691882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.730963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daca9eb-cf3c-45fc-a57a-44b0d0f2695d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.738341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd64e-4c73-4db3-8c11-1654ece1302d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.741412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.769046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.769876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.770170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.770448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.775862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.776726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.777308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.777651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.778417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.779982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.780896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.782375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-dfda8db8-d31e-46dd-8bab-e988248fe016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:35.801225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:35.802101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:35.802989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:35.802989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:35.802989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:35.802989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:35.803192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 243/466] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:35 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:35.803192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.803318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 224/467] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:35.804149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.804149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.804149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.836027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:35.837759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:35.929831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b565ffa-8497-4bb7-8510-a3d3128b2c1a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:35.948915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:35.974158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:35.974849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:35.975130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:35.975407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:35.976139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:35.976447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:35.977262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 225/468] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:35.977868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:35.978641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:35.996515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 244/469] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:35.996515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.101918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:36.121221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2cb31f-614b-4972-ba40-ae6feb57453a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.129332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd00592-846f-459f-ab98-78d182c83926 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.157423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.158237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.158512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.161357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.162234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:36.162538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.164755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.168930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.169905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.170309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.170689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.179900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 226/470] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:36.181143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.182795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.185021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:36.212156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:36.213256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:36.214301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:36.214301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:36.214301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:36.214301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.214800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 245/471] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:36.215588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.249632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:36.318077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892f8a-ca10-45ca-b2e3-42b2a15f6c1a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.335536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963ecc1-6853-42a1-9dea-9ae2b3fd3dcc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.362533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.363386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.363884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.364233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.365367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.367324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.372809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.373754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.374209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.374678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.375553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.377173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788efaf2-8016-433d-bea5-4d06c8da2359 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.395491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 227/472] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:36 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:36.396136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.404105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 246/473] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:36 2022] POST /identity/v3/users => generated 248 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:36.409609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:36.492179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd1c61-df8b-4c30-a53b-34a5bd6f5ad7 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.492527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd1c61-df8b-4c30-a53b-34a5bd6f5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.492810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd1c61-df8b-4c30-a53b-34a5bd6f5ad7 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.494491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 247/474] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:36.510057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.510410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.510604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.540051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:36.542040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:36.566933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81dd7-aeca-4326-823c-e7f94ce97dea None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.637237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.637883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.638169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.638440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.639169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:36.639472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.640860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.655655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 228/475] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:36.657219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 248/476] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:36.662335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.681527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.696665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:36.743874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:36.782579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d713d4-378b-461a-b046-c313f7fb50d9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.795298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0e7e3-ca92-485e-a03a-d6bf996cccab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:36.819899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.820881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.820991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.821215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.822056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.823576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.834540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:36.835650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:36.836110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:36.836583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:36.837739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:36.839499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:36.847678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.sql.core [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 23:25:36.847678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 23:25:36.847678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [parameters: {'id': 'ccc8e4f7f6534547801ab5609276b52c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 23:25:36.847678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 23:25:36.849258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 229/477] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:36 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jul 21 23:25:36.865793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:25:36.866723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application yield resource Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise self.value Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application session.commit() Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 23:25:36.867623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.flush() Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application compat.raise_( Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 23:25:36.868555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:25:36.869764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:25:36.870672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [parameters: {'id': 'ccc8e4f7f6534547801ab5609276b52c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:36.871472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 23:25:36.872248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:36.873059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 249/478] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 23:25:36 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:36.874393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:36.999576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c0ebc-c64a-49e8-9720-17d52c35ad7d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:37.035760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:37.050950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:37.051912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:37.053611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:37.053903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:37.067831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-be091ee8-e8f0-447a-be94-38a0702e049e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:37.076077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:37.076980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:37.077818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 230/479] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:25:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:37.085148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:37.178947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:37.207658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafba59f-8499-4ac4-b2f8-e4cc287a2f73 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:37.250764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:37.251422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:37.251707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:37.251981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:37.252788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:37.253093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:37.254502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d464e7-572f-4977-aa29-10c00e7d4006 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:37.270839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 250/480] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:38.365997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11b2c-f03d-49f9-bae1-1381119244cf None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.366480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11b2c-f03d-49f9-bae1-1381119244cf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.366480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe11b2c-f03d-49f9-bae1-1381119244cf None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:38.368105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 231/481] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:38.372982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.373400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.373564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:38.394198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:38.395394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:38.488961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 251/482] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:38.523438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe11b2c-f03d-49f9-bae1-1381119244cf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:38.650247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe11b2c-f03d-49f9-bae1-1381119244cf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:38.702799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:38.703956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.704467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.704955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:38.726078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:38.734241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:38.735120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:38.735919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:38.738451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 232/483] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:38.744275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:38.842940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:38.890426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7552c-35ce-4f51-b88c-0e449866efeb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:38.942891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:38.943502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.943787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.944062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:38.944820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:38.945124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:38.946555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb66d4c-55e0-462e-8632-42369c73b486 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:38.959966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 252/484] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:38.965090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:38.979203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b75-40ba-4d8f-a732-ac07934c04fb None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.979521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b75-40ba-4d8f-a732-ac07934c04fb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.979771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875b75-40ba-4d8f-a732-ac07934c04fb None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:38.981434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 253/485] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:38.986607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:38.987091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:38.987560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.019719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:39.022585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:39.048936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.151830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734c6f-5f01-441e-919a-0e3b601f3b68 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.166246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 254/486] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:39.199086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.207671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.208709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.209139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.209439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.238226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.239715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.274496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:39.281487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:39.282329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:39.283173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:39.283173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:39.283173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:39.283173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:39.294264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 233/487] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:39.297089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.387620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f06a1f-3dec-4fea-bf1c-d27278de9e12 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.404754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.414202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d0586-74aa-4b42-b718-4104526ca952 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.435433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.436408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.437376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.437761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.452862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:39.454003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.454771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.455154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.455530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.456467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:39.456874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.458405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7f591bca-35e8-453d-901c-57bfaec24c9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:39.462645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:39.463542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:39.464337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:39.466745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 255/488] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:39.473614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cdfc3-5ef8-45a7-ae2a-10db9c381cd2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.474232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cdfc3-5ef8-45a7-ae2a-10db9c381cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.474683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cdfc3-5ef8-45a7-ae2a-10db9c381cd2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.476253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 256/490] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:39.477139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cdfc3-5ef8-45a7-ae2a-10db9c381cd2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.477555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 234/490] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:39.482386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.591912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cdfc3-5ef8-45a7-ae2a-10db9c381cd2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.612934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc4cff-d009-4c02-b1d4-ebeaac30a85c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.613615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.629007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.630318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.630828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.631311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.632269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:39.632793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.634471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296dbcf-9697-4d14-bc16-7beb5b96985e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.644722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 257/491] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:39.646338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.646828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.647319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.656505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.657330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.657615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.657893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.665125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:39.665898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.666867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:39.667367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:39.683849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:39.684802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:39.685765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 235/492] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:39.686320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.708876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.742276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 258/493] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:39.742928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.818804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b929-7188-4da5-b6bc-06e07ec13342 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.847897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553f0e-6ca4-4584-a52a-0d43226b335e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:39.858161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:39.858920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.859867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.860279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.860563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.872343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.873948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.884744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:39.885457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.885744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.886022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.887125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:39.887436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:39.888871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732c827-f54b-4a87-80fb-0186e84e641b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9439c769-ddd5-4b89-b8b1-6736842079af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:39.892660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:39.894043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:39.894960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:39.894960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:39.894960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:39.894960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:39.894960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 236/494] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:39.895720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792e51-bd83-4c4a-8595-6d752f401e26 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.895999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792e51-bd83-4c4a-8595-6d752f401e26 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.896269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64792e51-bd83-4c4a-8595-6d752f401e26 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.901704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 237/495] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:39.902109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64792e51-bd83-4c4a-8595-6d752f401e26 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.927399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 259/496] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:39.928715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894a12-d49c-4ceb-9c9c-ae9f5b5a74b6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:39.929001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894a12-d49c-4ceb-9c9c-ae9f5b5a74b6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:39.929309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894a12-d49c-4ceb-9c9c-ae9f5b5a74b6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:39.931375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 260/497] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:39.932066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8894a12-d49c-4ceb-9c9c-ae9f5b5a74b6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:39.978048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.012908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64792e51-bd83-4c4a-8595-6d752f401e26 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.037957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8894a12-d49c-4ceb-9c9c-ae9f5b5a74b6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.046172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.046961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.047242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.047513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.057535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8435d60d-8dda-4733-bf29-6ba6658e884c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:40.065238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.066151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:40.066957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 238/498] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.067627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1187-ab69-4c23-a7e3-9b0c427af754 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.067886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1187-ab69-4c23-a7e3-9b0c427af754 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.068118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d1187-ab69-4c23-a7e3-9b0c427af754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.076066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.076724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.077002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.077310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.078031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:40.078434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.079801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.084401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-979d1187-ab69-4c23-a7e3-9b0c427af754 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:40.085611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-979d1187-ab69-4c23-a7e3-9b0c427af754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:40.097400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 261/499] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:40.097400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.126774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.155715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 239/500] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:40.157058 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.157384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.157657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.184057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:40.185279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:40.208231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b01a98-93f8-48ce-acee-3866a1713c45 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.235825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.241660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.242312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.242592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.242868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.253540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 240/501] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:40.254726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.313357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.314816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.341731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.364378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f42ad1-1da3-4f70-8ebb-3436f1856ebe None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.399478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.400139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.400421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.400696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.401473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:40.401779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.403158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.411161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 241/502] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:40.411934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.417552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 262/503] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:40.417552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.462908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.511672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b9523-17b6-4911-97b7-7ecd4d207a7a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.512679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315de26-f1f3-4c82-8b45-f11d1489645f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.537842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.545737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.546022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.546535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.546806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.546897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.547087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.547173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.547356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.555556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.556995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.557671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:40.565547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.566574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 263/504] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.572218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:40.572918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.574030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 242/505] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.574913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.666371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79579a73-9762-4013-bce4-3b5882e8de3e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.676391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7df07d-69f5-49e7-a6c9-079ab44616c8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.685405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.699951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.700742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.701029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.701332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.712331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.713146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.713840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.713964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.714253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.714529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.725118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.726576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:40.730865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.731851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 264/506] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.732826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:40.745804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.746804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 243/507] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.752334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.783099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.842647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a4c1-40dd-483b-afa9-7c666b81282e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.846109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6bc19-2abd-45ca-8b0d-51bed0cf06cb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:40.876105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.876908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.877297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.878069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.880809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:40.881489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:40.881768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:40.882036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:40.882769 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:40.883069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.884447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.888688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:40.890152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:40.892525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 244/508] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:40.893549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:40.912094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:40.912983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:40.913869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:40.913869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:40.913869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:40.913869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:40.913869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 265/509] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:40.914150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:40.917808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:40.995042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d853f-8de1-49d0-b341-8ad5ae90e82b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.008545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.017807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e843ff-c35f-46fd-9f5f-3fe5865e5a48 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.029229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.029898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.030191 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.030471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.031303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:41.031620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.033084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.051539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.052229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.052578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.052920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.053737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:41.054110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.055535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.068119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 266/510] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:41.068925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.069322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 245/511] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:41.070255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.151965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.172189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66659a-01a5-4213-b132-a6facd9f6e45 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.172732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c41a7-8ea6-4c92-adb7-6c7d2ea67774 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.207476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.207833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.208289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.208494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.208581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.208778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.208874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.209054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.209803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:41.210110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.211509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.219018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.220467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.222478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 267/512] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:41.223267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:41.238581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:41.239501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:41.240349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:41.240349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:41.240349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:41.240349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:41.240349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 246/513] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:41.240849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.241498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.325455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f84-eb8d-4fd5-9191-c20142079c21 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.348825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf193-527f-4298-b449-5de995dd1929 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.358029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.358683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.358965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.359239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.359952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:41.360254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.361660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.375559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 268/514] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:41.376427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.379061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.384928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.385602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.385886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.386160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.451246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.452947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.454676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.481998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f763a5-915a-41f3-911f-5f87ddeb1a34 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.516402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.517060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.517370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.517640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.518944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.520466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.539349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 269/515] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:25:41 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:25:41.540139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.573278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 247/516] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:41.578416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.620188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.654053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990da4b5-1d21-4c67-bccb-cdac78ab7fe9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.684742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.694387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.695203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.695485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.695756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.704330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.705091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57907674-4847-4014-aeb9-79289ec55c76 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.705959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:41.724085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:41.725206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 270/517] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:41.726555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.747048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.747725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.748010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.748286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.749016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:41.749411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.750746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.764299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 248/518] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:41.765149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.838443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35627dbe-be5f-44f1-a2e6-d1060214fd0d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.863828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:41.872771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758b9f-432e-4643-8015-97b5c79596f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:41.876154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.876991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.877307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.878132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.887367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.889635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.908237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:41.909758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:41.909964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:41.910806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:41.911676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:41.912100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:41.912100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:41.912227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 271/519] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:41.912227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.923839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:41.925670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:41.944823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:41.945949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:41.947000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:41.947000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:41.947000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:41.947000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:41.952739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 249/520] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:41.952739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:41.974080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.033998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cac0f-f685-4c17-90b1-18c5f95ad827 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.055863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ec25-831c-4bb6-86f8-d02d2b10eda0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.071437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.072112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.072507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.072780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.073650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:42.073955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.075379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.094883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 272/521] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:42.095155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.095960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.096276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.096551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.099836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.108311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.108311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:42.123529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:42.124607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 250/522] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:42.125668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.129868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.216643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc3a79-c65a-423c-a674-1c04b04e509e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.225297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.233286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1e14a-f765-4d50-8732-071f01635276 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.254663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.255323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.255611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.255877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.256665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:42.256971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.258451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.272127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.273132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.273642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.274127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.275506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:42.276045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.277664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.278383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 273/523] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:42.279221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.295042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 251/524] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:42.296178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.365758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.396084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60c4d-80cf-4cd7-a8d4-be26964745ed None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.407108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768a2fd-d4d3-49d9-a5ef-fc3fd10d4f75 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.438082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.438998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.439468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.439739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.444587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.445281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.445565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.445893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.446729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:42.447041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.448485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.471983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 252/525] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:42.471983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.480627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.516998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.518521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.578681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c59ce-6e28-4971-825b-5c7b8b8157ea None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.602344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.615337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.616048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.616277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.616549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.617407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:42.617721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.619161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.624374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 274/526] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:42.625254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 253/527] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:42.625911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.626017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.717733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.761680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdddc549-8dd3-4b1e-b24b-2c031b0be650 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.786163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72befc-b2b1-4244-a48c-9f0c30c61ca5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.804149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.805026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.805323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.805532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.819113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.821096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.826621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.827523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.828017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.828534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:42.837947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:42.838820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 275/528] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:42.840066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:42.897445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.913383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:42.915308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:42.950191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05611fe5-8bab-4468-90d0-a4969bf70068 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:42.977179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:42.985952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55792060-e46f-481d-a183-e35665294db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:42.987350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55792060-e46f-481d-a183-e35665294db5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:42.987601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55792060-e46f-481d-a183-e35665294db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:42.988230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55792060-e46f-481d-a183-e35665294db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:42.999406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55792060-e46f-481d-a183-e35665294db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.000990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55792060-e46f-481d-a183-e35665294db5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-55792060-e46f-481d-a183-e35665294db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:43.020242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:43.021141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:43.022299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:43.022299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:43.022299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:43.022299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:43.022299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 276/529] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:43.022802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55792060-e46f-481d-a183-e35665294db5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.036989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 254/530] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:43.038213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.137030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55792060-e46f-481d-a183-e35665294db5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.153663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.161739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b426dda-bc81-4b2e-91bb-2b7de3d7aa00 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.182490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.183161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.184011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.184293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.185403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:43.185726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.187849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.199326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.200116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.200498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.200874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.201796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:43.202203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.203747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.205341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 277/531] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:43.206250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.219792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 255/532] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:43.220645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.260251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.337831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3e536-9412-4431-91df-bb1763e47c21 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.350844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573345b-96c2-4ebb-a00d-fdfc76098668 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.374436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.375361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.375602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.375880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.387032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.388505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.397948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.399095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.399532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.399981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.400961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=265bce5d41794e74833b744b83bd669a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:43.401442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.403025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:43.407871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:43.409429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:43.409429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:43.409429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:43.409429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:43.417108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 278/534] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:43.417108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.417675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 256/534] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/role_assignments?user.id=265bce5d41794e74833b744b83bd669a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:43.419912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.441247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.591248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7bf37-ec9c-4b48-b1de-59d38a273eb4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.609464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.629166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef117-4fcd-4774-8ace-90be59908ca3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.649648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.650316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.650596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.650868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.651755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:43.652057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.654130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284220f-c0db-4ff6-a018-5e9abf0a0ac5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.669831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 257/535] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:43.671404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c7c2-91e6-4362-a526-d650ff678108 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.671694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c7c2-91e6-4362-a526-d650ff678108 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.671969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5c7c2-91e6-4362-a526-d650ff678108 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.673221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 258/536] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:43.676412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.677433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.677846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.678331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.678841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c7c2-91e6-4362-a526-d650ff678108 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.687008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.689173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6516a0ce-8f35-4aea-9c0f-bf8bb65d938f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:43.708006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:43.709078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:43.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:43.712984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 279/537] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:43.714433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.714849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.715272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.735241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:43.737558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:43.769073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.818269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5c7c2-91e6-4362-a526-d650ff678108 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:43.827924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 280/538] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:43.828972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.875556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:43.877158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:43.878127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:43.878500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:43.887299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:43.889462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:43.909378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:43.910618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:43.911490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:43.912205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 259/539] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:43.913731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:43.940368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:43.966303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf26459-ddac-4317-a030-bc4cad31f30f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.012534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.013233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.013516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.013834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.014666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.014970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.016503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.035175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 281/540] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.036170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.039134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a68d-fdde-4981-872e-3c99598f8d9d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.068817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:44.075458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.076495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.076998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.077521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.090197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:44.101043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:44.102030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:44.102832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:44.105251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 260/541] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:44.106773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.152265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a02c-a7d9-4ff3-ae33-805cf81a6871 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.188132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.188797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.189077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.189400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.190788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.191037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.192586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.202352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:44.208325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 282/542] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.209529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.218841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fadaa-b0b5-4a45-8e66-40a5371a8f91 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.256203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.257023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.257435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.257814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.258805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=953c2242e2e047eca592608753cece82) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.259216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.260807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.273215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 261/543] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/role_assignments?user.id=953c2242e2e047eca592608753cece82&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.273215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.383148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:44.393596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736ddc-ce4f-47a1-a55b-b9dc6ef5c68d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.463743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.463944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.464221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.464498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.466216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.466216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.466963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.474710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb7ac8-1d6a-4d4a-8133-fe8ddf8e0741 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.483333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 283/544] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.492204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.526573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.527366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.527658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.527939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.528909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=163fd72c29a54d5d977f0114cd9dab06) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.529360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.531029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.551170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 262/545] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/role_assignments?user.id=163fd72c29a54d5d977f0114cd9dab06&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.564295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:44.607507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00d9ad-1118-45a3-82f5-678315768e44 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.654579 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.656212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.656687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.657152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.673390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.675477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-24d3e1c3-ee36-499c-ba12-e1bafa42035d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:44.704841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:44.705885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:44.706714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:44.706714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:44.706714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:44.706714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:44.709092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 284/546] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:44.715135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.786820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560cab5-d53a-4357-9abf-9c34cbe6390a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.787125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560cab5-d53a-4357-9abf-9c34cbe6390a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.787377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560cab5-d53a-4357-9abf-9c34cbe6390a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.788747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 285/547] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:44.794828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.795102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.795383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.817174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:44.818525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:44.897073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bb93-1c1a-4ba9-a33c-4da352b277e9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:44.933589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:44.937483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 286/548] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:25:44.957596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:44.958265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:44.958552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:44.958894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:44.959627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:44.959936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:44.961351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:44.981328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:44.990153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 263/549] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:44.998294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.038314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.121006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8951f-5c82-4528-9398-edb13151a547 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.163249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.164203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.164488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.164765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.179498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:45.195113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:45.196554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:45.197547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 287/550] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:45.215189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.232917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fad4f-fbed-44d9-890a-e3bfedb4fdb1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.323380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.324181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.324465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.324744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.341021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:45.342513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:45.370382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec845ac9-12ff-4dbc-9929-5cbf590d3328 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:45.372758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:45.373708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:45.374768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:45.385514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 264/551] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:45.387869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.388412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.436234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.436912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.441527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.442024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.442979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:45.443478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:45.445033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:45.454906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.459375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 288/552] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:45.477902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.521302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780372fd-9743-46e4-b9e1-ff32bbcbb2c2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.576453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.577454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.577950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.578405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.579424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:45.580132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:45.582216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:45.616915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 265/553] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:45.623952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.703718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530965-db4b-4e51-b960-b4fa7486aac1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.733348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.737647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07343d4c-805c-42e0-9fc3-afda82f9ce05 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:45.756721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.757757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.758259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.758427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.772381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:45.774013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:45.777475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:45.778389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.778875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.779348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-803df3bb-7441-4455-a291-23c5c8904c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:45.793411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:45.794352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:45.795214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:45.795214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:45.795214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:45.795214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:45.795214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 289/554] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:45.796284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc29a-6827-4e67-bc08-1984e19931c9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.796559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc29a-6827-4e67-bc08-1984e19931c9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.796909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc29a-6827-4e67-bc08-1984e19931c9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.798389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 290/555] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:45.805149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:45.805460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:45.805734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:45.825582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:45.827252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:45.848683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.858319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:45.860041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:45.929209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 291/556] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:45.929209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:45.984398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:45.992824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 266/557] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:45.993683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.049088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367180d-42e2-4c11-9d8f-4df81a1fd366 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.085529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.086315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.086673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.087023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.087838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:46.088213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.089769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.097580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1fb6-7ea0-4940-81f0-b4d405d1752e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.107502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 292/558] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:46.108519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.121576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.133633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.134431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.134714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.134991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.146333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:46.154061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.155633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 267/559] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.156634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.220370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.225685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48dafb-3295-4d76-bb36-bb5bb5ca8719 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.263297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.264394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.264856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.265312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.268713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f19f52-6958-41e4-9472-3163f6ccc7b1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.277126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.278802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:46.297681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.299986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:46.299986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:46.299986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.299986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:46.301880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 293/560] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.302827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.304751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.305570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.305853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.306230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.314590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.316571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:46.332004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.333228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 268/561] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.334326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.382582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.432102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3190a-1ea6-48b8-85c4-e06675575860 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.443798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20099a3a-a092-40b4-8dc0-d822f40371ea None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.461012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.470774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.472237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.472670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.473087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.474016 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:46.474488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.476074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.481346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.482211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.482332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.482548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.483270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:46.483567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.484973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.486089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 294/562] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:46.487802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.503735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 269/563] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:46.504596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.601531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c7595-97e6-49e4-b0a4-d82a97f1df02 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.610762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a5006-6d14-4618-8c50-661f6676a54c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.625832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.639558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.640494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.640924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.641403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.642459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:46.643604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.645343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.647360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.648162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.648435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.648712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.659928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.661435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.670758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 295/564] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:46.672006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:46.680133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.681233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 270/565] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.682176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.716091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.790341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b84f6a-5e7e-47b5-b756-def0c256c952 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.793913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05277bc-4e1f-479d-be66-e297cbf00c49 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.826702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.827504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.827784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.828058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.828305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.829095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.829407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.829683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.835336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.836788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.840474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.841949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:46.851092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.852091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:46.852999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 296/566] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.853516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-22799d1c-396a-4025-b1fe-8ec202314615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:46.859966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:46.860933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:46.862012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:46.862012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:46.862012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:46.862012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:46.862012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 271/567] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:46.862909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b0d4-48d0-4897-a0b4-506016f1d41d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.863197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b0d4-48d0-4897-a0b4-506016f1d41d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.863474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23b0d4-48d0-4897-a0b4-506016f1d41d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.865303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 272/568] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:46.866493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da55c97-5211-4fa9-8eea-6c64e8c82af4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.866781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da55c97-5211-4fa9-8eea-6c64e8c82af4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.867062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da55c97-5211-4fa9-8eea-6c64e8c82af4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.868567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 273/569] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:46.870001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da55c97-5211-4fa9-8eea-6c64e8c82af4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:46.900174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.952507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:46.959233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc28c-1f19-4372-8ad3-0aa89e94cd4f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.973736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da55c97-5211-4fa9-8eea-6c64e8c82af4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:46.993280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:46.993945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:46.994232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:46.994512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:46.995236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:46.995550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:46.996924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.007187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37980611-8310-44bd-8498-0855c383d064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.007838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980611-8310-44bd-8498-0855c383d064 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.008122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980611-8310-44bd-8498-0855c383d064 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.008395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37980611-8310-44bd-8498-0855c383d064 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.009203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980611-8310-44bd-8498-0855c383d064 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.009513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980611-8310-44bd-8498-0855c383d064 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.009896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 297/570] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.010730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.010924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37980611-8310-44bd-8498-0855c383d064 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.029034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 274/571] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.030288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ed7a-5bd6-4481-b9f6-8bacd1b6474c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.030583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ed7a-5bd6-4481-b9f6-8bacd1b6474c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.030860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ed7a-5bd6-4481-b9f6-8bacd1b6474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.046758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a951ed7a-5bd6-4481-b9f6-8bacd1b6474c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:47.047945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a951ed7a-5bd6-4481-b9f6-8bacd1b6474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:47.114794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.117976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212651-19af-4958-bd08-afb552915cc2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.119052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 275/572] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:47.120106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.120394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.120659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.137230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:47.138419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:47.156060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.156728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.157009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.157313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.158032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.158338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.159733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.170785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 298/573] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.171563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.204482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.210005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 276/574] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:47.210884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.275677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b0361-c583-4cfb-b735-dbfedf36de59 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.310059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.310857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.311139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.311485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.319307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.319715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3e1d-7fd0-44b4-a9d7-17ff9c6945ea None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.320751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:47.336078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:47.337146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 299/575] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:47.338124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.359758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.360742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.361442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.362110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.362330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.363173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=152e60dec2154281b85d5626fd836813) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.363483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.364937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.370496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 277/576] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/role_assignments?user.id=152e60dec2154281b85d5626fd836813&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.371272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.453775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.454659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d306-d03f-4a0f-8d2c-c283bb768d7f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.494717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.495526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.495814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.496121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.498768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f315f-00d4-4c9e-9422-a2bff32554e2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.507815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:47.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:47.517088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:47.518584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 300/577] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:47.519271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.544746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.545610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.545894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.546166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.553739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.555189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:47.570543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:47.571647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 278/578] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:47.572565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.618528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.641420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ff1ec-d122-4264-a4a3-648829b23eca None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.680783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4573bf-fce8-474b-a3a6-73a535c15676 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.681125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.681953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.682309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.682513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.693200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:47.701015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:47.702073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 301/579] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:47.708552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.713117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.726282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.727167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.727344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.727630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.728468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.728780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.730241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.749168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 279/580] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.749850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.818185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e6e4-197c-4e5b-a8f6-62cd3d90ea9b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.855126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.856064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30524-b3c3-447c-bda4-ec4f2ae34a8e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:47.856726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.857212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.857726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.858792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.859171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.860547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.874606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 302/581] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.874606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.875382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.898694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:47.899600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:47.899883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:47.900155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:47.900937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:47.901271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:47.902693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:47.915215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 280/582] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:47.916036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:47.961928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:47.994345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac116-fd87-4a56-9081-7dec2eeeeb41 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.025865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8b39d-a8ca-4c2f-89d5-0c5d1b8188ef None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.029951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.030671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.030957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.031230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.032031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:48.032340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.034408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.047808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 303/583] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:48.048604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.062418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.063218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.063507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.063783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.075056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.076515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:48.094579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:48.095700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:48.096758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:48.096758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:48.096758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.096758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:48.096758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 281/584] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:48.097128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.128947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.172180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890dc5b-e90d-4cb6-a142-08584610dac5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.205430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.212246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.213151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.213508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea59b96-9ec4-4532-b477-9a6a331dc593 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.213609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.213999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.225457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.227005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:48.244818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:48.245906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:48.246999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:48.246999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:48.246999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.246999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:48.248208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 304/585] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:48.249068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.255892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.256967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.257279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.257563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.272998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=7524c2f848694708b1828c655383361c, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.274485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.287881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 282/586] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:48 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:48.288441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.408002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b7022-6229-45cc-a720-b9ad12b28408 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.411061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f38edf-2f58-4969-85aa-913f7073f539 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.432972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.459581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.460409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.460707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.460905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.461025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.461812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.462165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.462516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.463699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:48.464602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.466205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.474015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.475499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.481252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 283/587] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:48.482172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.487442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:48.498544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:48.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:48.500749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:48.500749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:48.500749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:48.500749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:48.505272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 305/588] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:48.507214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.622360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292ed23-6c15-46c8-924c-7669f7157e14 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.624577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b488fc5-0e29-42a4-a9fb-f1d7a97377b2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.662472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.663341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.663727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.664280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.672860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.673705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.674586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.675016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.675420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.675599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.676463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:48.676914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.679161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:48.697505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:48.698438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 306/590] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:48.699778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.700311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 284/590] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:48.700713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.737095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.782848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:48.824518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d227-a710-4553-9b72-b1f23e4e2fd7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.826885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82266e-e25e-487e-8afa-4ef6cf6c0b55 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.860161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.861366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.862213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.862461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.863435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:48.863567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.864935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.868913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:48.869866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:48.870373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:48.870851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:48.871885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:48.872409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:48.874129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:48.878609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 285/591] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:48.879448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.893241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 307/592] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:48.894481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:48.987349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22766-0e19-4722-9442-131d7eac2ce5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:48.994178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.010296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541f96c-5d8d-4e4d-89e4-86a5868ecda1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.014697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.026056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.026853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.027135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.027409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.035899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.037533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.052458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:49.053218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:49.054145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:49.055087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 286/593] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:49.055669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.061486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.062045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.062558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/265bce5d41794e74833b744b83bd669a/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.080785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=265bce5d41794e74833b744b83bd669a, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.082760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.098956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 308/594] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:48 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/265bce5d41794e74833b744b83bd669a/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:49.100282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.175456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695d04-e354-44c8-a446-5b0eb0a0ccf6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.214365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.215470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.215584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.215782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.224522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.225433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed5454-bc04-43d1-a133-9401f0874628 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.226080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:49.242304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:49.243295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:49.244822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 287/595] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:49.257375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.300481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.302581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.303286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.303568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.303845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.310536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:49.310536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.310536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.332378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.357900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 309/596] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:49.365530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10b17-100e-4c5a-b906-9a2bd9fe4180 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.365730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.408953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.409664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.410069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.410346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.411462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:49.411775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.413402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.434128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 288/597] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:25:49.440053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.503024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb17a0-d57f-4fcc-9339-70febfd49d4b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.542582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.543572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.543978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.544759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.556963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.558609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.558829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8a91b-fbe2-4f9f-98b8-169eb1e035a3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.560794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7cd07e36-01b3-4968-b050-69c805887fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:49.580990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:49.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:49.582993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:49.582993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:49.582993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:49.582993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:49.587822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 310/598] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:49.589564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370602e-2baf-410a-b3cf-591938b64f8f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.589999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370602e-2baf-410a-b3cf-591938b64f8f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.590251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370602e-2baf-410a-b3cf-591938b64f8f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.596011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 311/599] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:49.596981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370602e-2baf-410a-b3cf-591938b64f8f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.602127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.603165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.603631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.604088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.616082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.617888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a26eee58-df69-41c0-a678-217e64a2e2b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:49.636987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:49.637960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:49.638875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:49.638875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:49.638875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:49.638875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:49.640865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 289/600] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:49.642337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.643312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.643764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.653693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.661074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:49.662600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:49.712941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370602e-2baf-410a-b3cf-591938b64f8f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.735242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 290/601] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:49.736962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.767321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.767912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.768247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.768662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.769463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:49.769771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.771363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.797340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 312/602] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:49.798650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.836208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.860016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a02ea-56ab-42b3-ab5b-88c35e0ce9db None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.910392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a761d60-be98-44c7-93af-24e4af27df24 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:49.913640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.914313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.914594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.914868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.915593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:49.915901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:49.917324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:49.925721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:49.930378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 291/603] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:49.931377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:49.960370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:49.961805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:49.962508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:49.963392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:49.978182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:49.988640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:49.989653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:49.990493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:49.993286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 313/604] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:49.994425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.067561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37192402-52e6-403e-94d2-02aa560e2011 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.107413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.108451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.108915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.109360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.117783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.119410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.124231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04269735-78f0-4f8d-bd89-4854f78731b7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:50.134902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:50.135991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:50.137396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:50.144542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 292/605] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:50.145622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.149537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.165442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.166346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.166665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.167007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.174270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.175867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:50.192028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:50.192923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:50.193838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 314/606] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:50.195045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.224353 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.258656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5727e-aa74-4d80-942f-51bf77c47bc9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.295270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.296406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.296895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.297400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.298346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:50.299397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.300984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.302871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fbc5-8622-4d7e-9081-f65751f495b5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.310272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 293/607] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:50.311449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.344592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.345177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.345808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.345970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.346729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:50.346931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.348377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.366252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 315/608] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:50.366252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.389948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.429917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237300f-a16d-4a76-8223-b89899c51601 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.459526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.466724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.467741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.468258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.468772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.470021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:50.470727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.472551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.474030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568f87-5553-424c-8a64-83bb4ee3ecf9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.488104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 294/609] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:50.489314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.511452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.512520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.512800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.513064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.524889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.526367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0cb907a7-c162-4cf4-8123-0b390fef70a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:50.544141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:50.545054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:50.546244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:50.546244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:50.546244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:50.546244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:50.550569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 316/610] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:50.551824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e5dd-d242-4e53-94e2-5c20366fcd82 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.552082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e5dd-d242-4e53-94e2-5c20366fcd82 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.552341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99e5dd-d242-4e53-94e2-5c20366fcd82 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.557645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 317/611] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:50.557645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e5dd-d242-4e53-94e2-5c20366fcd82 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.599923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e5ff1-0ab2-4829-bfca-fbf6042379ea None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.625452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.635070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.635961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.636242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.636517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/953c2242e2e047eca592608753cece82/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.652348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=953c2242e2e047eca592608753cece82, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.654637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.669132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99e5dd-d242-4e53-94e2-5c20366fcd82 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.672433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 295/612] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:50 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/953c2242e2e047eca592608753cece82/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:50.673558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.711632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.712756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.713142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.713764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/163fd72c29a54d5d977f0114cd9dab06/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.728205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:50.735047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=163fd72c29a54d5d977f0114cd9dab06, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.737399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efa169-4b6a-4ee6-aaff-b52ae880dfdb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.756741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 318/613] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:50 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/163fd72c29a54d5d977f0114cd9dab06/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:50.758624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.759088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.759498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.785975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:50.787702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:50.872753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f0e35-88c4-4b79-a258-4c03d34933cd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:50.879007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 319/614] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:50.913505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.916197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:50.916884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:50.917166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:50.917533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:50.918271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:50.918576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:50.919971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:50.932854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 296/615] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:50.938812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:50.979885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.056342 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e0647-aa30-435b-874d-8af0e706adbb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.058927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c23f5-4ce3-42be-9d29-5e6a2de02287 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.085294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.116440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.117284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.117573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.117848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.118949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.119743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.120021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.120292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.136295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.137970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.143836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:51.151679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:51.152603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:51.153498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:51.170559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:51.172884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:51.175932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 297/616] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:51.181849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 320/617] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:51.181998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.182156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.348043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda150-d2a2-40ab-bb82-63232007b0c7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.358779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.365985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3d45-2684-45f3-b81b-6b7b45553cf9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.392461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.393080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.393445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.393716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.394569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:51.394878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.396345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.402514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.403194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.403484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.403767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.404527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:51.404837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.406255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.415779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 298/619] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:51.416040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 321/619] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:51.420975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.421253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.494510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.570113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec836d0-02a1-4dbf-b0b1-786e120c2c88 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.571605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8553d-628e-4520-a73b-b948a02791af None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.608952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.610314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.610801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.611416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.614425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.615622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.615883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.616163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.623996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.625866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.629913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.631377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:51.650034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:51.650944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:51.651830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:51.651830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:51.651830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:51.651830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-40e349c6-a39a-4d94-a62b-19867cf46656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:51.658817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:51.659701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 299/621] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3386-81f6-4a7d-8be9-0abdfb79617b None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3386-81f6-4a7d-8be9-0abdfb79617b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3386-81f6-4a7d-8be9-0abdfb79617b None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.660598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 300/622] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:51.661119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3386-81f6-4a7d-8be9-0abdfb79617b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.661795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 322/622] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:51.662869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.683026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.780666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.790923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3386-81f6-4a7d-8be9-0abdfb79617b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.794845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a299-cf87-4b5e-b2f7-09f4d84f2863 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:51.833518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.834522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.835029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.835524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.836403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:51.836670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:51.837068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.837391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.837677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.837887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.838398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:51.838707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:51.839896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aa128-a188-48b3-9a8a-c1db281b6374 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.840074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:51.852677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 323/623] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:51.854279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1e06-037a-4448-bcba-978282ca454f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:51.854803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1e06-037a-4448-bcba-978282ca454f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:51.855286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d1e06-037a-4448-bcba-978282ca454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:51.860141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 301/624] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:51.860141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.877966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-757d1e06-037a-4448-bcba-978282ca454f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:51.879559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-757d1e06-037a-4448-bcba-978282ca454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:51.942691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:51.981207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 324/625] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:51.981207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d1e06-037a-4448-bcba-978282ca454f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:51.983975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a83d0-3a2e-443b-a81e-38d76f0accf7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.045093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.046161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.046441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.047127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.056678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.058943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.074759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:52.080757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:52.081958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:52.082917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:52.089609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 302/626] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:52.090693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.109727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d1e06-037a-4448-bcba-978282ca454f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.159030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.160235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.161005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.161588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.171338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.173263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:52.192451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:52.193695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:52.194873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:52.197552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 325/627] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:25:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:52.198773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.210402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956489-8942-438a-9d71-38cad3e061f5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.242078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.249338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.250445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.250719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.251152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.263131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:52.272350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:52.273480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:52.274507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:52.276726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 303/628] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:52.277724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.330127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b61ee-2a58-47a5-bdbd-d807d2084a81 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.368986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.369892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.370185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.370575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.371457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:52.371859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.373401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.384317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.393443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 326/629] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:52.393443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.403847 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaf61c-35d0-4e6e-b008-fbd5ce0d9dbd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.452845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.454071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.454777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.455799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.457397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:52.458143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.460370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.488342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 304/630] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:52.488342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.508035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc7b37-b32d-46f3-ad55-aedba156146d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.545200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.545936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.546220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.546495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.547236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:52.547790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.549659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.555265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.559955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 327/631] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:52.560912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.618454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c28ea4-0a16-478c-8aed-6a906abb1cdd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.638871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.661394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.662653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.663385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.664316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/152e60dec2154281b85d5626fd836813/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.684572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=152e60dec2154281b85d5626fd836813, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.684870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107cded-3772-4fc0-85df-4ae4fb56ac54 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.686813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.707291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 305/632] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:25:52 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/152e60dec2154281b85d5626fd836813/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:25:52.713219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:52.752500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.754004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.754525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.755249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.890808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:52.902222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.903685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b30fe-fe64-4595-a7fc-7ecb58607799 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:52.904043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9a5db-a5e1-4d17-9a4d-4433bdd861df None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:52.979639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:52.980348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:52.981409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:52.981409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:52.993737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:52.995318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.006889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:53.015770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.016742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.017749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:53.017749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:53.017749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:53.017749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:53.017998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 306/633] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:53.023000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.054365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 328/634] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:53.055799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45307-67df-4939-89be-5abc315c9563 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.056186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45307-67df-4939-89be-5abc315c9563 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.056466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d45307-67df-4939-89be-5abc315c9563 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.058197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 329/635] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:53.059347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d45307-67df-4939-89be-5abc315c9563 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.151108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d58b-6482-454b-8979-f47de1621050 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.178924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d45307-67df-4939-89be-5abc315c9563 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.188535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.189670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.190123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.190668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.191554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:53.192015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.193827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120763bf-0c9c-4c8f-864f-0efd4289af4b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.206425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 307/636] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:53.207870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.208164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.208446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.218951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.219750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.220449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.221259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.226355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:53.227623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:53.230816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.233049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.234725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e1048e28-8556-4656-8ba2-db2a5ba9304e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:53.256153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.257334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.258426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:53.258426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:53.258426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:53.258426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:53.262163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 330/637] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:25:53.263604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e88c41-234c-44ad-ba01-afd775abd35f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.263897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e88c41-234c-44ad-ba01-afd775abd35f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.264172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e88c41-234c-44ad-ba01-afd775abd35f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.265689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 331/638] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:53.266341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e88c41-234c-44ad-ba01-afd775abd35f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.282056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.313272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 308/639] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:53.313272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.388957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e88c41-234c-44ad-ba01-afd775abd35f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.422261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9cd5b-28b5-4c53-9b62-966ede9eb7c2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.428017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.428906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.429313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.429657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.437950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.439741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-40976539-8e76-42ba-8041-6d413a1a48af None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:53.456425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.457616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:53.463536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 332/640] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:53.464313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.464313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.464502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.464585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.464675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.464759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.464847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.464936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:53.464936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.464936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.472808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.480484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:53.481287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 309/641] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:53.481732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:53.482072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.555720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 333/642] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:53.556996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.560983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.605690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d9d8-96df-4739-a5ec-46dfe2fc5fb0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.646381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.647507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.648080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.648368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.662193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:53.668847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a94b06-3ed3-417c-8285-84fd265360e1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:53.672278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.673503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 310/643] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:53.679523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.708671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.709377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.709664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.709943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.710787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:53.711099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.712533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.731151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 334/644] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:53.732383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.751154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.797246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175c33-e9ec-4d2f-91df-9bf7e0f30aba None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.801420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:53.831224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.832102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.832481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.832825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.840333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:53.841876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:53.842335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c055a-a674-476e-9d98-bed5f41c86b0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:53.861440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.862757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:53.864037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:53.869501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 311/645] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:53.869501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.883282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:53.884196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:53.884556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:53.884842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:53.895675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:53.903404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:53.904372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:53.905231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 335/646] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:53.905944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:53.984255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55405f-1666-4196-8bff-9489637e0840 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.013708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.021609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc970e-c71f-41fe-af30-60cc60bc4595 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.033261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.033934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.034213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.034632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.035750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.036059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.037918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.043796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.048104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 312/647] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.049603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.062136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.062905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.063190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.063466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.147297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.148884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.155823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65078091-6496-40e2-b0bf-eb6b32851e72 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.189120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.190795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.191081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.191353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.192126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.192429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.193857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.206887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 313/648] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.207557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.253277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.264630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 336/649] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:54.264630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.287090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.321925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38951c05-4810-4d8f-8890-88f8de244ddc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.357853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.358637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.358921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.359309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.360054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.360363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.362422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.368834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a355c7-cae7-407a-9475-d48522543549 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.371478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 314/650] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.372334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.411574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.412386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.412667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.412942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.423260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.425548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:54.443795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:54.444720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:54.445646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:54.445646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:54.445646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.445646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:54.445646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 337/651] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:54.445936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.485954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ef91-e9e5-432b-8b35-3a34489f6477 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.490291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.525739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.526314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.526597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.526872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.527694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.528004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.529572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.530696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.545235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 315/652] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.545235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.572774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6fa67-ea20-4464-900d-e2f69c2bfecd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.614272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.615103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.615387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.615664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.628214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.629862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:54.650053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:54.651021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:54.652499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:54.652499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:54.652499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.652499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:54.652499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 338/653] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:54.652775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.708801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93a0d2-74fe-4e4c-b2ce-68b35a6dc7e5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.750665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.752410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.752685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.753253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.769499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.771104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.780531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b05ba-ab5c-43ef-a1ef-509f99781f0f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:54.790822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:54.791758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:54.792639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:54.792639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:54.792639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:54.792639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:54.792639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 316/654] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:54.793504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.817419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.819981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:54.832235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.833323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.833829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.834166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.834989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.835349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.836802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.851526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 339/655] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.856501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:54.934306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cd708-0353-4731-8592-520eba00e787 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.966904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dd1c3-b74c-448f-a721-00bf84604866 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:54.969716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:54.970380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:54.971297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:54.971810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:54.972288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:54.972588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:54.973965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:54.991761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 317/656] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:54.991761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.010144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.010892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.011173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.011703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.012422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:55.012722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.014113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dece4d3-ce06-49ca-bf98-e9e4ee65b5cc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 340/657] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243a1c-e58c-414e-978b-fc0aa5f330ce None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243a1c-e58c-414e-978b-fc0aa5f330ce None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243a1c-e58c-414e-978b-fc0aa5f330ce None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 341/658] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:55.030978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243a1c-e58c-414e-978b-fc0aa5f330ce None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.085113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.088783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.107807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7cf86-dd99-4751-9ab9-0ae28422d352 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.145994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.146879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.147063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.147331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.154752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.156215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.156817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243a1c-e58c-414e-978b-fc0aa5f330ce None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:55.171788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:55.172964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 318/659] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:55.179257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.201393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.202192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.202471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.202741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.209865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.211298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7c334c08-1ad4-4137-8a23-1dd72ff842f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:55.226100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:55.226987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:55.227886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 342/660] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:55.228687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.228781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.229052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.247010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:55.248195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:55.301085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbab1cc-493c-4b22-a267-893888735d41 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.321958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 343/661] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:55.323195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.344458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.345440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.346350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.346640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.354361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.355892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.360016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.371978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:55.375526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:55.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 319/662] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:55.378846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.443802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eec78b-503a-4c6d-8739-1846eea3c957 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.477751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.478423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.478705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.478980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.479821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:55.480130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.481585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.488381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d91fc-1558-4aa5-9364-6bc6665393ef None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.503550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 344/663] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:55.503550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.529170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.529952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.530235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.530514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.531293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:55.531602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.534073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.551483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 320/664] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:55.551483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.600778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.608088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c3405-eede-460a-9913-c0dc53ab48bd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.614747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.643623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.644426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.644768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.644980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.655123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:55.660421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952b1cb-8ef2-43f4-9a4e-c3df27297f5f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:55.662874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:55.663787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:55.664621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 345/665] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:55.665347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.699317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.700604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.700891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.701165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.702016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:55.702324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.703975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.726588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 321/666] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:55.726588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.775368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bec4e-394b-49d8-8c43-ca2a0057e1b2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.816948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.817620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.817827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.818102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.839112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afc01b-ab13-4948-a8ce-0d7144d62f17 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:55.843433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.859116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:55.879100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:55.880026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:55.880309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:55.880587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:55.881445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=265bce5d41794e74833b744b83bd669a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:55.881765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.883194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:55.889798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 322/667] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/role_assignments?user.id=265bce5d41794e74833b744b83bd669a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:55.890479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:55.900219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:55.902106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.030853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405e37-9408-492c-a1cc-2d381c1f6735 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.041516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 346/668] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:56.041516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.085061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.086445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.086445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.086445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.087126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:56.087320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.089208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.099148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 323/669] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:25:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:56.100055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.122061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.166903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.177245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074f3aa-2492-41d0-94b6-9bfb5b1082e4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.216421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.217278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.217661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.218035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.239011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2906ea2-3af3-495f-b7cc-85596ecfaf67 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.287474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.289142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.289723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.290263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.296110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.297737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.304777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.306447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:56.332803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:56.333938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:56.334816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:56.334816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:56.334816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.334816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:56.337304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 324/670] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:56.338867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.366435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.428566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 347/671] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:56.428566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.470107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.479450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bdafc-03f0-4a50-ba4e-6188155da5da None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.525621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.527304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.527953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.528520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.540350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd36f9-a077-4f3e-8dcd-625d4873266b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.545158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.546838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:56.567039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:56.568000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:56.568901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:56.568901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:56.568901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.568901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:56.573292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 325/672] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:56.574252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.584179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.585613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.586087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.586531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.587833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:56.588312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.590467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.606074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 348/673] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:56.607228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.628030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.703724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be797-e9a5-48cd-b9f1-735d69ddc25b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.726894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5bdb1-8d58-4965-a8e6-122c4ec7265e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.746674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.747469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.747748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.748018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.759785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.761266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.762873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.763591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.763870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.764150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.764869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:56.765171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.766544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.771407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.781314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 349/674] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:56.781314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-399ee5cf-369a-4496-a6ac-bdcfe913fc97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:56.781748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:56.782793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:56.783921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:56.783921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:56.783921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:56.783921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:56.784823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 326/675] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:56.786390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abd4d-6db7-43bf-8f62-8ac7ca70352c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.787024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abd4d-6db7-43bf-8f62-8ac7ca70352c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.787399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abd4d-6db7-43bf-8f62-8ac7ca70352c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.792883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 327/676] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:56.794633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abd4d-6db7-43bf-8f62-8ac7ca70352c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.874384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:56.901637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abd4d-6db7-43bf-8f62-8ac7ca70352c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.902241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3eddf-839a-47b9-ac56-ba7e31a4b30a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:56.937778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.938345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:56.938561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.938842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.939114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.939593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.939972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.940355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.947037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.947517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:56.948609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.949064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:56.962385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:56.963440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:56.964543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:56.970044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 350/677] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1d20143b-d462-4f97-be89-424a6bea1659 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:56.970179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:56.971878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:25:56.973106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:56.973802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:56.973886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 328/678] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:56.973886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:56.973886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:56.973886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:56.989322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:56.990523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:57.049503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.062172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 329/679] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:57.063127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.104736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb31de-9c08-45a7-a809-a9a3f1511d30 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.146594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.147175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.147466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.147728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.148442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.148742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.150201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.151929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.168289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 351/680] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.168289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.195926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0d081-9fc1-4856-974c-8e6ffda3598c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.232346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.233002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.233321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.233596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.234377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.234677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.236656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.248320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 330/681] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.249102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.281774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f8aa-3450-4a23-87c0-f396df255ed2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.301337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.320828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.321830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.322328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.322780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.323791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.324295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.325926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.344998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 352/682] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.347023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.357054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6de31a-f92d-47d5-9a3a-2a3c40599de7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.392109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.393491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.393771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.394046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.402712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.404715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:25:57.413262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:57.414301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:57.415142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 331/683] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:57.415845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.457437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbde45-f8f8-4a07-ae27-11dcf49092a9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.493564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.494367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.494640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.494908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.502410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.504057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:57.518351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:57.519410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 353/684] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:57.520318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.527354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376c21-7926-4ee6-a715-b677338d26aa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.539079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.565599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.566260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.566546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.566824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.567653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=953c2242e2e047eca592608753cece82) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.567967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.569439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.575631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 332/685] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/role_assignments?user.id=953c2242e2e047eca592608753cece82&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.576509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.656938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1532-1675-4641-9f08-3ca3042ffb66 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.672419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.697305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.698133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.698400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.698741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.700881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c17096-6f65-48f9-a816-e23a9f5fea58 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.740357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.741443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.741907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.742380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.743451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.743951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.745789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.756712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 333/686] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.757919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.794620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.796058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.808273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.895348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babab2f-0206-43cb-ba0e-f7f99a8f78e6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:57.917152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 354/687] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:57.917962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:57.934704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:57.950349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:57.950881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:57.951160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:57.951441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:57.952268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:57.952567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:57.954018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:57.967553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 334/688] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:57.968422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.061804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d63a1-7703-4480-be3f-95ea8fb5f0ec None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.069321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.076781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547b11-ea04-484f-8b97-63311d078232 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.113345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.114151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.114429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.114698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.117352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.118480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.118767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.119043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.129607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.130826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.131085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.132319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:58.149807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:58.150758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 355/689] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:58.152258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-29a2984d-9c13-4e06-b63d-ebed55d9c3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:58.153463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:58.154362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:58.155282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:58.155282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:58.155282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:58.155282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:58.155282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 335/690] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:58.156351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c5-0224-4271-acdb-2b8799e1ff0f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.156643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c5-0224-4271-acdb-2b8799e1ff0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.156923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e9c5-0224-4271-acdb-2b8799e1ff0f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.161322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 336/691] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:25:58.162100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e9c5-0224-4271-acdb-2b8799e1ff0f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.227362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.268277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5050a84c-2f16-4c18-98d8-eeb34adb30bf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.274780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e9c5-0224-4271-acdb-2b8799e1ff0f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.306393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.307046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.307321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.307591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.308414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=163fd72c29a54d5d977f0114cd9dab06) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:58.308727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.310280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.314468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.315131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.315413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.315687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.316404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:58.325371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.325575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 356/692] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/role_assignments?user.id=163fd72c29a54d5d977f0114cd9dab06&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:58.325575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.325751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc5914-11fd-428a-b5c4-5e6bd39a5819 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.341386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 337/693] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:58.342886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.343182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.343453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.372465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:58.375027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:58.379966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.458401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ee7fa-fa9c-4ab1-a0bd-13239737d724 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.484663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 338/694] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:25:58.486323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.491008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.507411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.508085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.508365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.508639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.509649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:58.509758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.511063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.527361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 357/695] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:58.531836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.630079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebe32a-20af-439a-bcff-bf22c87a7447 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.653999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4894a-3f51-486e-8013-9044f0ff8e43 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.669094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.669951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.670280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.670613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.678721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.680319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.682241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.693113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.694308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.694941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.695428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.696295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:25:58.697763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:58.698684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:25:58.699628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:58.700968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.703703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 339/696] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:58.704549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:58.716776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:58.718003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:25:58.718848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:58.722209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 358/697] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:58.723228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.778799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:58.825144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2274-26ad-404f-b82d-93a0e381feab None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.829588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238b65-1df1-437f-88d4-c42c6dd072c4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:58.865305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.866357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.866785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.867205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.867396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:58.868278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:58.868705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:58.869121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:58.870108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:58.870462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.872023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.877239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:58.878943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:58.896174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 359/698] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:58.896174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:25:58.901362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:58.902450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:25:58.903551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:25:58.906010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 340/699] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:58.907024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:58.983608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.022457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91b43d-cfe7-469a-94a3-837fc6794698 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.038168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8cc68-1319-43af-8cd5-83fc9bc0ed5f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.042244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.070598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.072175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.072644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.073098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.074050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:59.074590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.076030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.076550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.077849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.078375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.078823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.085264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 360/700] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:59.086281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.174564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.176193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.228271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13514e-6bbe-434b-aee2-847862edbeed None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.238535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.276301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.277833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.278493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.278942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.280491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:59.281257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.283767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.287072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 341/701] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:25:59.287956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.300145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 361/702] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:59.301564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.349411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.406660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df574d26-8d2f-4303-ab18-1b833b6dfe65 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.440206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1311d6-7113-49a8-9e84-15148b33207f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.444302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.445084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.445488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.445866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.446675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:59.447083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.448570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.455432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 342/703] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:59.456496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.489366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.491684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.491925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.492146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.492425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.520879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.522414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:25:59.555885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:25:59.556828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:25:59.557769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:25:59.557769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:25:59.557769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:25:59.557769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:25:59.558792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 362/704] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:25:59.566303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.632298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f379-fbd3-4cda-8a4e-b045207601c3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.671623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.672253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.672544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.672823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.673796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=152e60dec2154281b85d5626fd836813) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:59.674110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.675550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.683016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 343/705] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/role_assignments?user.id=152e60dec2154281b85d5626fd836813&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:59.712443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.730248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200d204-ca8f-4700-81e8-bec8bd7a74d6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.776965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.778044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.778551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.779021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.779958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:25:59.780459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:25:59.782073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc644e-34d5-48e7-ae65-bebfcffa4bb4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:25:59.796580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 363/706] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:25:59.802828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:25:59.925219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:25:59.942594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42372706-88a2-45eb-a1ce-d0d2e7eabde7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:25:59.956202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9517aa-c742-40ff-bbc1-3427b69662cd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.956504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9517aa-c742-40ff-bbc1-3427b69662cd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.956760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9517aa-c742-40ff-bbc1-3427b69662cd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.958411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 364/707] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:25:59.963680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.963960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.964240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:25:59.985877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:25:59.987635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:25:59.990133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:25:59.992008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:25:59.992509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:25:59.992975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.002292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.004078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:00.024145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:00.025105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:00.026045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:00.029306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 344/708] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:00.031335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.088599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 365/709] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:26:00.118062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.140963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84575-a5fb-4362-9de1-11fba7547fbc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:00.184835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:00.185564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.185848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.186117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.186893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:00.187199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.188818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.201963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 345/710] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:00.208132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.217285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:00.219703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:00.243920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3bde-3369-49fe-bf98-a1d5f6db9e66 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:00.317929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:00.318748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.319028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.319299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.338303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.339786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:00.373168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:00.374168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:00.375110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:00.375110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:00.375110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:00.375110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:00.375110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 366/711] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:00.376490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c48fe6-f6de-4f25-a20f-936528f187a0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:00.390977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.427118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:00.427780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.428057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.428327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.429152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:00.429483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.430930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.446754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 346/712] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:00 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:00.569721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603889b-9f5b-478f-b108-03c075e0fcc4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:00.609412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:00.618638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:00.619542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.619827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.620104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.620838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:00.621144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.622556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0c677-310e-43bd-8ba0-46828fc7d831 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.642787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 367/713] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:00.648228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.663132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d2fc-b513-4217-af81-207d2c84356e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.663811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d2fc-b513-4217-af81-207d2c84356e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.665178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50d2fc-b513-4217-af81-207d2c84356e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.666256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 368/714] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:00.671655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.671942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.672232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.706597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:00.707744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:00.771024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:00.803526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42569c-a238-44e2-860c-dcb52c07a195 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:00.841452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:00.842131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:00.842418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:00.842700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:00.843421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:00.844866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:00.855389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 369/715] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:26:00.879139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:00.903528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 347/716] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:26:00 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:01.031678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8aa647-c909-4492-b903-2bc0d21528e4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:01.051682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:01.077494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:01.078670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:01.079183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:01.079657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] PATH_INFO: `/v3/services/network` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:01.081034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:01.082634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:01.096841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:01.097895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:01.098729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:01.101567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 370/717] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:00 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:01.107021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:01.218063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746bda-97bd-4158-a0cc-67c271cb4551 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:01.244994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:01.255242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:01.255972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:01.256258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:01.256584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:01.257375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] RBAC: Adding query filter params (name=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:01.257683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:01.259053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef71a2-0977-4123-ab9e-512c95b8060f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:01.263780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 348/718] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:01.270149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:01.388763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f76473-3227-45b9-a0df-719c5137763d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:01.424312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:01.425003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:01.425326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:01.425598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:01.426325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] RBAC: Adding query filter params (type=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:01.426627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:01.428048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe12903-30b1-4586-ad9d-5bf2ae067767 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:01.435080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 371/719] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:01.961414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e14d-047c-4179-ad3f-375484ae7c1a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:01.961793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e14d-047c-4179-ad3f-375484ae7c1a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:01.961979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e14d-047c-4179-ad3f-375484ae7c1a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:01.963610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 349/720] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:01.968442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521f64-58f0-4470-8a37-2e6a9a9ef33e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:01.968732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521f64-58f0-4470-8a37-2e6a9a9ef33e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:01.969007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37521f64-58f0-4470-8a37-2e6a9a9ef33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:01.998166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-37521f64-58f0-4470-8a37-2e6a9a9ef33e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:01.999352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-37521f64-58f0-4470-8a37-2e6a9a9ef33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:02.052794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:02.094274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 372/721] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:26:02.118245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e14d-047c-4179-ad3f-375484ae7c1a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:02.248786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e14d-047c-4179-ad3f-375484ae7c1a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:02.296610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:02.297304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.297592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.297869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.299190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:02.300706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b5b51-5602-4b0f-a979-282de22291eb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:02.335104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 350/722] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:02 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:02.529537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c7e7-9a12-4d8d-b23f-d02f91648cb2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.530533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c7e7-9a12-4d8d-b23f-d02f91648cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.531040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c7e7-9a12-4d8d-b23f-d02f91648cb2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.533512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 373/723] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:02.538828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.539131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.539390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.566837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:02.568068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:02.623737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:02.661951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 351/724] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:26:02.684746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25c7e7-9a12-4d8d-b23f-d02f91648cb2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:02.792104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25c7e7-9a12-4d8d-b23f-d02f91648cb2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:02.826994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:02.827789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.828069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.828343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.838835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-87356389-d2e0-46c3-94c5-6de917fc82d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:02.846940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:02.847879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:02.848716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 374/725] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:02.854184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:02.915840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10881-f9dd-4636-b50a-cc4faf563395 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.916150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10881-f9dd-4636-b50a-cc4faf563395 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.916391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10881-f9dd-4636-b50a-cc4faf563395 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.918035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 375/726] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:02.923771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:02.924181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:02.924473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:02.944196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:02.945438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:03.009581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.011846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5ebe6-172b-4665-af55-13a8eb885351 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.074012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 376/727] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 23:26:03.086435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.087119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.087404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.087682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.088431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:03.088790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.090245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.097108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.105720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 352/728] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:03.113090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.189354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.237474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671f07e-25c6-493f-8804-73aaa37229f1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.257791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f24c-ad9c-4eb5-9667-4c833b423c78 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.293775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.294811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.295265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.295699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.308980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.311044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:03.330079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:03.331149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:03.332216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:03.332216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:03.332216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:03.332216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:03.334063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 353/729] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:03.339456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.381903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.382718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.383001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.383277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.429846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:03.437645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:03.438799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:03.440024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:03.445626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 377/730] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:03.448488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.454186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.457639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdecaf4-b2ca-43dd-b4ad-cd05315f9f21 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.494335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.495346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.495831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.496300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.497212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:03.497701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.499327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.508834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.514078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 354/731] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:03.521311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.638532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d4fda-4644-4053-b98b-5be692adcbf5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.683514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.684962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.685899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.686429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.698010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.700378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.701701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0aebc-81f7-40ed-a499-12ec66b4514a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-90e05ea3-d8e4-4b0a-b1e8-57de92ac4cde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:03.720939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:03.722098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:03.723021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:03.730553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 355/732] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:03.731173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f43a-c65d-41c1-bd90-be7a7a712a49 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.731173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f43a-c65d-41c1-bd90-be7a7a712a49 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.731361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7f43a-c65d-41c1-bd90-be7a7a712a49 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.732678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 356/733] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:03.733965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f43a-c65d-41c1-bd90-be7a7a712a49 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.747791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.748470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.748769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.749028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.749818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:03.750127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.752048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4693ead-3814-4a27-a616-cb26bb25bbe4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.753812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.761079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 378/734] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:03.762676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.762970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.763252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.780935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:03.782201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:03.861339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 379/735] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:26:03.861339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.874010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7f43a-c65d-41c1-bd90-be7a7a712a49 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:03.874575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:03.923111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:03.924644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:03.925122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:03.925638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:03.926798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:03.927399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:03.929010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:03.953053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 357/736] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:03.955195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:03.970125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2553-3e8a-464e-9726-42c40d39bd35 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.007587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.008390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.008673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.008947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.026596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.028790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.040755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:04.053794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:04.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:04.055787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:04.055787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:04.055787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.055787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:04.055787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 380/737] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:04.056090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.085757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe4e74-ea22-4f74-9636-7c97a0763750 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.129444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.130362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.130645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.130918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.134304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.144290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1d88d233-2976-4684-8800-95e923e2ca8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:04.152544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:04.153518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:04.154618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 358/738] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:04.155430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea176-56de-4330-bc24-a7e5f823206d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.155430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea176-56de-4330-bc24-a7e5f823206d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.156071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeea176-56de-4330-bc24-a7e5f823206d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.161394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 359/739] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:04.162216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea176-56de-4330-bc24-a7e5f823206d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.170994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d0c18-cb18-41a2-b975-a23d3e90ad56 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.205834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.206418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.206699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.206973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.271583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeea176-56de-4330-bc24-a7e5f823206d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.277689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.279144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5046e-030a-4ecb-be4b-24fd5628c48d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.298673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.307893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.308670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.309091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.309370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.310077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:04.310381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.311860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.329105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 360/740] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:04.329105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.355488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.391636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 381/741] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 23:26:04.393801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.394288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.394751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.412002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:04.413232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:04.432880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a45f62-b25f-4126-8484-c3604de54caa None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.473102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.473731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.474173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.474459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.475669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:04.476098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.480011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.493211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 382/742] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 23:26:04.493211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.498922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 361/743] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:04.500324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.557434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.590662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.594451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c8ba-7ddd-46a9-b35e-051c14190cbb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.612400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7af1-ad8b-4459-a023-a653ce8a592a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.632097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.632939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.633243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.633804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.641177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.643253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.649250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.650049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.650335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.650611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:04.658566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:04.659604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 383/744] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:04.661164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.667138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.668694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:04.686441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:04.687430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:04.688325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:04.688325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:04.688325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.688325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:04.692433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 362/745] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:04.693019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.773837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f358d-c03a-423d-b7d4-b9d1d72c965b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.801634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ec60-f7a2-4ef2-aebe-9e1838c4d8ec None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:04.803278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.811452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.812253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.812545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.812817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.824584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.826088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.839526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:04.840194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:04.840534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:04.840824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:04.841695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:04.843067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:04.844285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:04.845807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:04.846778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:04.846778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:04.846778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:04.846778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:04.846778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 384/746] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:04.847098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.862512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:04.864219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 363/747] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:04 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:04.865061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:04.976327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183c2e-53f9-4525-932f-d05f7055b629 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.023990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3bd31-03d8-4b91-a992-052eec2a9323 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.029680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.030762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.030762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.031188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.032106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.032491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.034966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.053976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 385/748] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.054825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.073346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.074023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.074303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.074573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.075286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.075586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.076962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6609475-d482-42ed-a32d-2f6045d23471 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.097045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 364/749] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.097852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e6e-ccb8-4e60-827b-b51d157b0e26 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.098139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e6e-ccb8-4e60-827b-b51d157b0e26 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.098419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9112e6e-ccb8-4e60-827b-b51d157b0e26 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.100028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 365/750] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:05.100746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112e6e-ccb8-4e60-827b-b51d157b0e26 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.124603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.130716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.167031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36fa11-00c4-40ec-a212-40c8f9aac4a8 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.202862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.203671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.204026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.204364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.205754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.206056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.207494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.219718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 386/751] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.220880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.221938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9112e6e-ccb8-4e60-827b-b51d157b0e26 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.261828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.262635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.262915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.263185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.275332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.276726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-19c058de-a7c2-40cf-a4bd-38de57735c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:05.295358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:05.296281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:05.297163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:05.297163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:05.297163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:05.297163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:05.297163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 366/752] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:05.298081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.298935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.299809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.317829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:05.319026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:05.330417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e2f5b-0945-4b33-ac7b-4f9ad27c504f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.357584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.372307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.373120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.373451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.373733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.381783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.383293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:05.398540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:05.399466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.400334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 387/753] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:05.400805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.402008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.410095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 367/754] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:05.410908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.522287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a63f55-4a28-4438-8816-e8460ce597d7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.524168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969ee6a-b7f0-4408-af0a-5caceea42f96 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.558260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.558996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.559274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.559545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.560118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.560782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.561067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.561505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.562356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.562662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.564591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.567805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.569244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.580964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 368/755] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.580964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:05.584220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:05.585115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.586086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 388/756] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:05.586665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.633674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.651379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.688062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cefe-22c1-432b-b7f5-257b5b79264a None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.697103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909adab-dde4-46d7-b39d-894735f06815 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.726051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.726864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.727145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.727424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.728082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.729485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.732392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.733308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.733765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.734210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.735154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.735633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.737279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:05.741794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:05.742699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:05.743671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.747911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 389/757] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:05.748697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.759169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 369/758] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.759169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.859600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a47738-9271-4ad6-ac1f-b3ce1575c44e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.861163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1b7a3-1e04-408d-a6b9-153fdd7bf0ef None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:05.871940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.882094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:05.896877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.897587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.897872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.898157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.898990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:05.899301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.899471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:05.900268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:05.900549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:05.900744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.900837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:05.908750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:05.911190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:05.923134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 370/759] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:05.923134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:05.926207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:05.927084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:05.927987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 390/760] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:05.928471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.032270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e9f75-6f88-49cd-9ac0-6a01303fb7bc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.035448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dc1b-5189-409d-85c3-e543827192c5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.069927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.070587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.070867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.071138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.071836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.072142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.073528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.074627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.075403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.075690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.075970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.076798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=152e60dec2154281b85d5626fd836813) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.077097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.083456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 371/761] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.083619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.083709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.088894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 391/762] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:05 2022] GET /identity/v3/role_assignments?user.id=152e60dec2154281b85d5626fd836813&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.097310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.140169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.146558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.206933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a56488-4c9f-4b8a-a772-dc688f420915 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.221592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311e0f-cdef-49ca-96ea-3e5082c816ce None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.245616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.246416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.246764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.247112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.259498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.260321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.260701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.261069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.262267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.262673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.264236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.278972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 392/763] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.279565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.324567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.326050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.376297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.407400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.415107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad9b8f-52cf-409a-8871-d09d15a86a1b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.456945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.458062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.458603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.459131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.460102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.460502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.461992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.462792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 372/764] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:06.463985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.472363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 393/765] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.477440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.599041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55639906-0cbc-48e7-b262-28aac8098ad9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.612325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c9e04-b743-431b-b20a-d56c5b39e3e7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.640607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.641757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.642117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.642398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.653464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.654678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.655230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.655708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.655814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.657293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.659058 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=7524c2f848694708b1828c655383361c, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.660785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.677006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 373/766] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:06 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:06.677619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:06.678526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:06.679543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:06.679543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:06.679543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:06.679543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:06.680895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.683613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 394/767] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:06.684602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.685152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.704718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.809629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fa8bd-f9d6-4564-a22a-3b84d94f4e57 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.849562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.850651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.851143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.851625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.852560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.853092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.854729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.870210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 395/768] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.876656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:06.931001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e5e1-a0bd-4aa4-be59-9fc617cdb89c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:06.974430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:06.975488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:06.975979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:06.976524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:06.977648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] RBAC: Adding query filter params (interface=public, service_id=cabb1c867004497e981a64b37a8aaf30, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:06.978205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:06.979788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:06.984597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:06.990926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 374/769] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/endpoints?service_id=cabb1c867004497e981a64b37a8aaf30&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:06.997566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.023967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a137f96-0cb9-4667-b928-9fc52ee3713c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.070651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.071592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.071867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.072136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.080059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.081675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.089638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0f11428f-2c15-42fd-9be3-6742f601064f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:07.098662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:07.099910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:07.100806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:07.103664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 396/770] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:07.105097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca819-b710-463d-ae26-13e3b04129a5 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.105747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca819-b710-463d-ae26-13e3b04129a5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.106186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca819-b710-463d-ae26-13e3b04129a5 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.112492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 397/771] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:07.113814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ca819-b710-463d-ae26-13e3b04129a5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.138086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303d04a-e1b7-4373-b400-e3de950a911a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.184502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.185093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.185879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.186236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.187259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.188697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094fc48-78f2-4f21-88d9-f0f2bc3e85f5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.197105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 375/772] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:06 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:07.198460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.198817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.199189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.221444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:07.222998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:07.239932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ca819-b710-463d-ae26-13e3b04129a5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.279899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:07.288802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.289931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.290219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.290498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.291597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:07.291964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.293614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.305325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 376/773] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:07.309313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 398/774] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:07.315323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.336616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.429549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:07.475787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40c36d-2add-454f-a5e1-8b3a41a13ce9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.503881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc950b-b2da-442b-a8cd-4366130a6c5e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.521344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.522292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.522577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.522859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.523864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=1352bc3b2bcd474b920ff7cd151e445a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:07.524479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.525967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.535129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 377/775] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/role_assignments?user.id=1352bc3b2bcd474b920ff7cd151e445a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:07.544834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.545811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.546174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.546514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] PATH_INFO: `/v3/services/network` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.547264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.549590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:07.563008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:07.564267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:07.565364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 399/776] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:07.572620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.698224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bdd1c-7f9e-4cdb-b50a-38e8e133437f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.733294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:07.752596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.753307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.753589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.753862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.754583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:07.754885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.756272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.765333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 378/777] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:07.772303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:07.838936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:07.891330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602e30e-9e78-4b7d-9423-315a90445841 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:07.940063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:07.940732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:07.941006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:07.941299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:07.942007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] RBAC: Adding query filter params (type=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:07.942306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:07.943685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:07.953304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 400/778] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:07.959713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:08.088078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7acc08-f993-42c2-933c-51c45ab8a0f0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:08.147710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:08.148374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:08.148654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:08.148927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:08.149738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] RBAC: Adding query filter params (interface=public, service_id=1e06b32a1f074233a5cce3a3a720ebcb, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:08.150044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:08.151416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cd8ce-2d00-45ea-9888-6c6a22d9cea7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:08.161518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 379/779] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:07 2022] GET /identity/v3/endpoints?service_id=1e06b32a1f074233a5cce3a3a720ebcb&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:08.167085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:08.309021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6c78-fd98-40c5-ab1c-5cd0ba9c9507 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:08.336620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:08.355593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:08.356192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:08.356472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:08.356746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:08.357448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:08.358822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309766-5e35-4166-a655-f29c0e061e8f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:08.369401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 401/780] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:08 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:08.568110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795c56-d73f-47c4-854d-42b4a7278786 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:08.568110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795c56-d73f-47c4-854d-42b4a7278786 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:08.568110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4795c56-d73f-47c4-854d-42b4a7278786 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:08.569200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 380/781] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:08.574665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:08.575207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:08.575701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:08.593581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:08.595179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:08.665774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 402/782] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:08.689431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4795c56-d73f-47c4-854d-42b4a7278786 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:08.748844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:08.833142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4795c56-d73f-47c4-854d-42b4a7278786 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:08.883873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:08.885107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:08.885608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:08.886327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:08.902043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:08.910176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:08.911090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:08.911917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:08.913995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 381/783] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:08.919091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.077790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c651e7-4d80-4cdc-86fc-222fe6e5d1c8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.098872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:09.123744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.124543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.124922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.125336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.126183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:09.127759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:09.129265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dca103-21fc-4189-a007-3b8948691e18 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:09.138554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 403/784] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:09.144765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.276629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e93a-cb7d-4782-be9e-bc7133604f25 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.276990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e93a-cb7d-4782-be9e-bc7133604f25 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.277208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573e93a-cb7d-4782-be9e-bc7133604f25 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.278879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 404/785] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:09.280794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000688e-cc52-4077-b013-da150157bff7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.286627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.286920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.287207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.298656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:09.320377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:09.321593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:09.341928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.342723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.342999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.343267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.364874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:09.366719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:09.390442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:09.391407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:09.392966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:09.392966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:09.392966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:09.392966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:09.395245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 382/786] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:09.401140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.479924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 405/787] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:09.521761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.533443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f581d5-872c-4d16-a03b-9db0b4647a31 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.569356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.570833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.571327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.571802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.572714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:09.573242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:09.574821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:09.587681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 383/788] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:09.601907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.658108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:09.665559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f117a3a-5cb7-4cec-930e-5a0737d038b9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.667917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:09.704132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.705599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.705882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.706154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.716542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:09.725313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:09.726249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:09.727101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 406/789] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:09.732368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.742039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c18dee-a035-4d6e-b95d-f37f8a9f55c8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.780712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.781984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.783054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.783736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.791774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:09.793737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:09.812638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:09.813651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:09.814880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:09.817644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 384/790] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:09.827706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.850782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eef796-8651-4916-8b2f-ba9754159485 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:09.887505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:09.888235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:09.888565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:09.888841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:09.889641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:09.889940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:09.891449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:09.901064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 407/791] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:09.906829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:09.941792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:09.993565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.008538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd906b-3de9-492b-958c-2227c1b1122c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.024832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b407e-6748-4f8b-a4a4-80b43a277334 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.062151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.062865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.063147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.063422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.074397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.075069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.075353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.075628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.075965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.076461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:10.076767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.077978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.078221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d442f-9e1c-4ad3-ab60-fb0c0a77f969 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.102903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 385/792] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:10.102903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5f50-57cb-46a2-881a-e5202c4220ce None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.102903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5f50-57cb-46a2-881a-e5202c4220ce None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.102903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5f50-57cb-46a2-881a-e5202c4220ce None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.102903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 386/793] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-fc55bf2c-d459-4979-92bb-ac9f600318b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:10.103359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:10.104160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:10.105035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:10.105035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:10.105035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:10.105035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:10.110660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6960-05ef-4614-af1a-6ed91bf0adce None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.110660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6960-05ef-4614-af1a-6ed91bf0adce None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.110660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c6960-05ef-4614-af1a-6ed91bf0adce None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.111053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 408/794] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:10.111583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 387/795] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:10.111583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c6960-05ef-4614-af1a-6ed91bf0adce None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.112594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9a-b374-4622-bb9d-6516f703c0e2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.113220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9a-b374-4622-bb9d-6516f703c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.113220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782b9a-b374-4622-bb9d-6516f703c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.129531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5b782b9a-b374-4622-bb9d-6516f703c0e2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:10.130987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5b782b9a-b374-4622-bb9d-6516f703c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:10.204352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 409/796] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:10.206029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.206319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.206596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.225404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:10.226086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c6960-05ef-4614-af1a-6ed91bf0adce None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.226639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:10.228641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.267827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.268620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.268896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.269166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.282179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.284380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.286792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.296073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 410/797] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:10.296700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:10.310242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:10.311170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 388/798] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:10.317564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.417048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ad119-a687-4e6b-af44-43c3c2afdde6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.420988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cad782-40ed-4780-8397-8888dde658b6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.451924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.452718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.452998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.453301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.458144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.458803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.459085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.459357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.460066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:10.460367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.461764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.464614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:10.468759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:10.472655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:10.473876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 389/799] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:10.479674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.480448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 411/800] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:10.480448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.538328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.588459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5963d-fe00-411f-aefc-9111da00d79f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.591977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706e1e-311f-42aa-8b1a-3b83d70d0c86 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.624620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.625315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.625601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.625924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.627013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:10.627324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.627562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.628364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.628642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.628745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.628909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.629597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.631318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.641483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 390/801] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:10.642897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:10.647617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:10.648549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 23:26:10.649415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:10.653471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 412/802] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:10.654185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.717597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.763039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecf8af-5522-4499-80d5-a6fbf55283bf None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.768039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe5df-f39d-4f77-b9a8-cc3f327ea206 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.778069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.803193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.804020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.804298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.804571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.804832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.805528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.805808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.806076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.806821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:10.807117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.808492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.812732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.815592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.818096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 413/803] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:10.819557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:10.831235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:10.832223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:10.833158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 391/804] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:10.833787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.937454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cffe7-2458-4581-813b-a61b55342ca0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.938536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d555fba-3075-4b25-931d-0dcc9600f7af None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:10.961560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:10.975166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.975360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:10.975980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.976083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:10.976276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.976378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:10.976530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.976621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:10.977240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:10.977603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.978966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:10.988666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:10.988828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 392/805] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:10.988828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:10.988994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:11.003968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:11.004869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:11.005802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 414/806] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:11.006296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.033945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.100514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d25f0f-5ec3-4fa0-834b-1bb9ee379cf3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.119516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff89b-49a6-4908-9216-d77a2c3d3857 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.138673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.139461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.139741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.140013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.150468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.151896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.154164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.154825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.155108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.155385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.156215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:11.156524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.158570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:11.169497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:11.170549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 393/807] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:11.171478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.176501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 415/808] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:11.177329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.219106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.268994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.275170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b74cd-e3b3-4eea-96f9-a27bb788470f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.279170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e6d9-ad4a-4ee6-ab20-427be1eef123 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.308885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.309569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.309849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.310119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.310922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:11.311224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.312637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.313138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.313853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.314167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.314433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.315129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:11.315430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.316766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2791cce-880c-4af9-8fdb-f09bbd0b1398 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.321819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 394/809] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:11.323034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da8f72-deb3-4698-9f47-2b152bfce99d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.323320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da8f72-deb3-4698-9f47-2b152bfce99d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.323598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da8f72-deb3-4698-9f47-2b152bfce99d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.328887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 416/810] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:11.328887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.329097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 395/811] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:11.329097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da8f72-deb3-4698-9f47-2b152bfce99d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.429117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da8f72-deb3-4698-9f47-2b152bfce99d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.430695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836b375-50c1-40c9-966d-5fae71ed4045 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.432233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.462854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.463494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.463774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.464049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.466276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.467053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.467438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.467715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.468428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:11.468731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.470887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.482565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 417/812] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:11.483422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.491405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.536576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.538043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.583014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7efc7-5631-4f7a-a675-956b1e295617 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.616763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.617671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.617946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.618217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/152e60dec2154281b85d5626fd836813/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.620163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=152e60dec2154281b85d5626fd836813, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.621602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137823a6-0e3c-4931-a357-04f567aaebc0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.633489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 418/813] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:11 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/152e60dec2154281b85d5626fd836813/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:26:11.634702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.634984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.635257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.653135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 396/814] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:11.653135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.653800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:11.654421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:11.676295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.719236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:11.748140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 419/815] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:11.758555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.770598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142a599-d599-46c5-b4fb-69d26fb83903 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.812503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.813300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.814106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.814570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.815364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.816740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.838421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 397/816] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:11.839566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:11.898402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b4a42-3da6-4f05-afbc-163af478e57e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.955691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:11.957043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:11.957362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:11.957640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:11.967974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d5151-b2a7-47fb-954f-cf008dcb773c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:11.968198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:11.969621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:11.983163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:12.000280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:12.001408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:12.002398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 420/817] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:12.003524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.014834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.021598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.022792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.023228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.023508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.036274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.037770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:12.058469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:12.059394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:12.060280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:12.060280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:12.060280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:12.060280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:12.060897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 398/818] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:12.062181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.159494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45618c99-2780-42b6-8ec8-774e5ed31ef2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.197860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.198991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.199536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.199831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] PATH_INFO: `/v3/services/network` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.200636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.202682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.204119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce013a38-96e0-4576-98dc-44b8e448715c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:12.221223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:12.222216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 23:26:12.223043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:12.227385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 421/819] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:12.228320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.242696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.243373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.243658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.243937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.244773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.245082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.246558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.266696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 399/820] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.272098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.294887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.310184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.344618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5d82-6997-43ee-bbf2-062a29ed4238 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.382832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.383113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ca26-c6c7-422f-b411-1641d848e295 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.383497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.383779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.384051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.384869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.385177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.386994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.405423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 422/821] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.406406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.421168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.421869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.422154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.422491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.423232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] RBAC: Adding query filter params (name=network) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.423588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.425177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.430303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 400/822] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.431277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.519199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5affd-0022-4f89-ad93-ed2a846a1410 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.526897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.547602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd6185-fee4-4b5c-a707-912676e3409d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.550222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.555700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.556696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.557532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.557806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.569944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.571517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.585262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.586169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.586524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.586873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:12.591323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:12.592159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:12.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:12.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:12.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:12.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:12.593031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 423/823] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:12.594189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.599358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.600909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:12.616986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:12.617944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:12.618820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 401/824] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:12.619422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.725391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2152dfc-6946-4152-a555-d490596ad031 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.741944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c7b05-3285-4c02-ad2d-0d633cf5f1d6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.769687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.770787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.771250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.771701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.772624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] RBAC: Adding query filter params (type=network) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.773118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.775106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.781722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 424/825] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.783422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.792777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.793525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.793804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.794075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.794792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.795094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.796495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.810392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 402/826] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.811431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.815889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.840674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:12.898425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10b85-d825-4dca-94ab-142ad047b297 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.928934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6857d5-6759-4256-a497-30dcf964a8ea None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:12.937048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.938001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.938478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.939661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.940639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:12.941256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.942870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.955894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 425/827] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:12.956953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:12.968315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:12.969359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:12.969651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:12.970288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:12.971441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:12.973125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:12.998342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 403/828] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:13.000175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:13.134700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:13.143359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16492ba-fd13-4804-b012-a7371bb52f08 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:13.154133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:13.190876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:13.191729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.192014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.192553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.199560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:13.201038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:13.207611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262057-b095-4136-913b-58f57c2e9135 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:13.216057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:13.216946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:13.217877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 426/829] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:13.223823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:13.263348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:13.264015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.264296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.264569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.265442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:13.265754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:13.267257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:13.273669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 404/830] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:12 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:13.347112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81aaa-580a-4b84-83fa-4cdc428e9f68 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:13.386422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:13.387022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.387308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.387586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.388393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:13.388703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:13.390188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e1797-76a9-4045-9e22-345375e80b84 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:13.404213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 427/831] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:13.410469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:13.526747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df0ae-4011-4c9b-86e5-1174a6697b9d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:13.552118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:13.565069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:13.566207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.566632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.567043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/1352bc3b2bcd474b920ff7cd151e445a/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.583501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=1352bc3b2bcd474b920ff7cd151e445a, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:13.585212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72efbb-98d3-4923-b7e4-86ea305f0403 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:13.601659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 405/832] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:13 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/1352bc3b2bcd474b920ff7cd151e445a/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:26:13.841792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb21a-c611-4267-9f69-831e0a39a55c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.842294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb21a-c611-4267-9f69-831e0a39a55c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.842688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbb21a-c611-4267-9f69-831e0a39a55c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.844404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 428/833] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:13.850238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:13.850712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:13.851012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:13.868569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:13.869787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:13.939655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 406/834] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:13.962816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbb21a-c611-4267-9f69-831e0a39a55c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:13.991373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.078348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbb21a-c611-4267-9f69-831e0a39a55c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.116465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.117513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.117945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.118394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.130509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2697de64-f5c5-40fb-904a-759780a7a662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:14.138711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:14.139836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:14.140912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:14.143995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 429/835] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:14.149619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.182944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64a83-9e91-4b81-8daa-a6f9bc2778dc None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.183224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64a83-9e91-4b81-8daa-a6f9bc2778dc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.183503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd64a83-9e91-4b81-8daa-a6f9bc2778dc None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.186105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 430/836] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:14.191123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.191408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.191684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.209713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:14.211007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:14.252729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a58d8b-8a89-4aa2-b85c-ff9c75e0c461 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.255150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.290638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 431/837] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:14.293944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.294773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.295214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.295644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.296526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:14.296969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.300153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.309477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 407/838] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:14.315447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.318393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.332234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.420972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae279f4-0f0c-4386-aba4-2fdb704650c0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.428138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc3efa-3983-445a-9a4a-370b3ae81c52 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.456564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.457414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.457697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.457983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.468660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.469109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.470501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.471179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.471657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.472173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.473143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.474729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:14.487777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:14.488673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:14.489795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:14.489795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:14.489795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:14.489795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:14.489795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 408/839] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:14.490634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:14.491574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:14.492387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:14.494523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.496693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 432/840] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:14.497940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.516915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.595694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.605720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02691a5-e37d-460c-b460-b31864462d2f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.623979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9cb7-143d-496c-bb89-85dee340a80c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.642828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.643629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.644015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.644582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.645243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:14.645721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.647190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.663992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 409/841] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:14.665257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.668826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.669822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.670352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.670831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.671796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:14.672313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.674464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.680337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 433/842] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:14.687974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.762089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.781295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832357b-9eab-47d2-a57b-604c53afb4b4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.794844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1e09d-538a-456c-99a6-9daff47bbe7f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:14.821261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.822263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.822641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.823032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.831185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.831313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:14.831918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:14.832198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:14.832474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:14.833083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.833210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:14.833492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:14.834844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:14.839876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 434/843] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:14.858160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:14.859659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:14.861766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 410/844] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:14.869095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:14.880027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:14.983543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061d7e62-bc69-4286-ae33-63427f9d7f92 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:15.023152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:15.024174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.024659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.025155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.026284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:15.026597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:15.028026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:15.049454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 435/845] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 23:26:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:15.054974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:15.159967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c72-2b96-47e6-a3ce-ae5d2f71d827 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:15.195984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:15.196644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.196927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.197222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.209785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:15.390123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:15.391617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab760d-b9e5-4550-814d-81cefcbf6d26 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:15.496340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 411/846] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:15.502554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:15.573390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:15.612312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9c4f-48ff-4025-bca5-ceab48bbd799 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.612634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9c4f-48ff-4025-bca5-ceab48bbd799 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.612874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e9c4f-48ff-4025-bca5-ceab48bbd799 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.614539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 412/847] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:15.615367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba52b9f-6669-4959-abb3-a5ffa6a71ce2 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:15.619823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.620110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.620385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.638242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:15.639588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:15.655649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:15.656786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.658524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.658524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.672331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:15.674984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:15.677907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:15.700847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:15.701835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:15.702733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:15.702733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:15.702733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:15.702733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:15.707098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 436/848] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:15.707956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:15.731450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 413/849] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:15.753757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:15.834384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a9089-e07d-4692-9f7a-6174469359b0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:15.853916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:15.867354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a1641-105e-42d6-9c22-ec9ff860a90c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:15.872656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:15.873394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.873681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.873954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.874955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:15.874955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:15.876508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595592e7-6ee3-4152-9da8-29ea57114ed9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:15.888386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 437/850] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:15.889494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d61f8-401a-45d5-a232-2c305c0b391b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.889777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d61f8-401a-45d5-a232-2c305c0b391b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.890047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d61f8-401a-45d5-a232-2c305c0b391b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.891364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 438/851] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:15.896856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d61f8-401a-45d5-a232-2c305c0b391b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:15.913376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:15.914141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.914417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.914684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.915380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:15.916800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-793287e3-0a13-46a3-b099-4a30f3dad912 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:15.930451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:15.931411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:15.932249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 414/852] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 23:26:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:15.933162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:15.933162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:15.933316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:15.950447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:15.951608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:15.979796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.010096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d61f8-401a-45d5-a232-2c305c0b391b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.041344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 415/853] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:16.042571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.046315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.047230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.047587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.048468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.061979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.063520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:16.080100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:16.080988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 439/854] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:16.081919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.125084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.171847 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb001c-7796-4d03-a1e8-6fb091712906 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.196558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cd508-51a9-43ca-98a5-a2b4c82a2fea None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.205387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.206054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.206337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.206613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.207314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.207618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.208980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.217841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 416/855] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:16.217841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.238371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.239162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.239443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.239716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.246036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.250483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:16.258857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:16.259808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:26:16.260661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:16.265563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 440/856] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:16.266144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.324326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7f8f4-9127-4dba-a2d8-6b53d63982bb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.360044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.360947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.361255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.361531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.362345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.362655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.364134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.382714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 417/857] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:16.382714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.476507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.484086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.490687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b307c-636f-4245-a5e0-46045608aedf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.496338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a834b-f3fc-401e-a4b6-432547af161e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.528002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.528673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.528953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.529256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.529976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.530279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.531649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.536473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 441/858] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:16.537284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.551752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.553028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.553504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.553928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.555533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.556133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.558219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.570603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 418/859] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:16.579141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.665171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e7469-c4cc-46d2-a934-c3025eefd54c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.711193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.712138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.712769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.713052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.715680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=152e60dec2154281b85d5626fd836813) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.715680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.716786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.722727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c3f6d-470b-4677-acf3-221cf49854b9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.726839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 442/860] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/role_assignments?user.id=152e60dec2154281b85d5626fd836813&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:16.769756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.770572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.770873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.771132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.785247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.790983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.801577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5e1a07db-d99d-40ed-99a5-dbc9d8e6d0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:16.811991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:16.812949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:16.813930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:16.813930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:16.813930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:16.813930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:16.814583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 419/861] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:16.820284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:16.854112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:16.941437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31cd0-e118-4bc2-ae80-6eedd4f5a2f5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:16.977580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:16.978468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.978912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.979330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.980191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:16.980636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:16.982159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905df655-0627-4a94-ba1f-8edc60c1ed7c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:16.992287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eff90-81a6-4808-8b02-3ebaadb10abf None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:16.993216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eff90-81a6-4808-8b02-3ebaadb10abf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:16.993723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eff90-81a6-4808-8b02-3ebaadb10abf None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:16.995543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 420/862] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:17.000074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 443/863] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:17.001579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eff90-81a6-4808-8b02-3ebaadb10abf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:17.002436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.002723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.003013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.019762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:17.020854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:17.092535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 444/864] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:17.113745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:17.121829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eff90-81a6-4808-8b02-3ebaadb10abf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:17.129871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:17.159413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:17.160591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.161075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.161574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.169904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:17.171643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:17.187317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:17.188284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:17.189930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:17.192500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 421/865] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:17.198137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:17.229085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dad49-3ec8-497a-bb82-742cb5637b64 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:17.260657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:17.267630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:17.268369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.268652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.268922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.269695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:17.271734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:17.287369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 445/866] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:17 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:26:17.314515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b777-1333-48e1-a925-29ac0ebc2b8b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:17.364395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:17.365378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.365809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.366270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.367300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:17.367815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:17.369525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:17.392214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 422/867] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:17.398188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:17.487447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:17.516175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb32e24-3d7c-4a29-ac4c-a1d92027ed27 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:17.557496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:17.558129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.558407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.558675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.634544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:17.636525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:17.713673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:17.742712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 446/868] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:17 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:17.748735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:17.856465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79eedf-8523-425b-84cd-b327e9e1052b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:17.881596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:17.896630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:17.897651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:17.898079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:17.898497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:17.909893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:17.911547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:17.930492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:17.931555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:17.932666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:17.932666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:17.932666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:17.932666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:17.934478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 423/869] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:17.940230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:18.056166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df116dfb-c364-4d94-b07a-00aa74c5dca4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:18.097462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:18.098388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.098840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.099254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.100130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:18.100576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:18.102119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:18.115171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 447/870] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:18.123845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:18.231960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2d4d-f6b2-4528-b9c9-81d91bb6686b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:18.268535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:18.269382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.269668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.269946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.277416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:18.278877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:18.294114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:18.295041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:18.296666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 424/871] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:18.302478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:18.338701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:18.412090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cac88-1617-4359-b910-007004139ff4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:18.448293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:18.448973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.449294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.449572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.450373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:18.450674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:18.452633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddcb57-604f-49eb-bb85-fb02e0069733 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:18.466637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 448/872] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:18.474290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:18.505528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:18.588496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abad73-b97b-451b-be52-5e642902966a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:18.627266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:18.628271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.628741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.629220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.630244 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=1352bc3b2bcd474b920ff7cd151e445a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:18.630774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:18.632607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a75b6-8fda-437a-b286-8d848e43e55d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:18.640192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 425/873] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:18 2022] GET /identity/v3/role_assignments?user.id=1352bc3b2bcd474b920ff7cd151e445a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:18.773327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8923-a6fa-4e12-a658-d37aecc22cee None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.774334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8923-a6fa-4e12-a658-d37aecc22cee None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.774826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d8923-a6fa-4e12-a658-d37aecc22cee None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.776881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 449/874] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:18.783594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac5d6-f606-4933-9e9c-9d21a12f346b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:18.784253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac5d6-f606-4933-9e9c-9d21a12f346b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:18.784741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac5d6-f606-4933-9e9c-9d21a12f346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:18.803897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-35eac5d6-f606-4933-9e9c-9d21a12f346b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:18.805527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-35eac5d6-f606-4933-9e9c-9d21a12f346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:18.878338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 426/875] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:18.902341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d8923-a6fa-4e12-a658-d37aecc22cee None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:19.004717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:19.013272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d8923-a6fa-4e12-a658-d37aecc22cee None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:19.035264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3441-15fe-4e68-a82a-79105c0384df None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.036365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3441-15fe-4e68-a82a-79105c0384df None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.036854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b3441-15fe-4e68-a82a-79105c0384df None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.039141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 427/876] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:19.044778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.045353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.045858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.051997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:19.052754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.053036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.053354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.054086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:19.055457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:19.065999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:19.067496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:19.077219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 450/877] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:18 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:26:19.101588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:19.159552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 428/878] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:19.182385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:19.292735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aa470-c6ac-4980-97fa-8e57ae290f49 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:19.328720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:19.329998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.330487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.330960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.331816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:19.333405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:19.346392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:19.347364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:19.348200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.350759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 451/879] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:19.356775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:19.459841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c7b3b-a888-4ed4-8868-1729dd56cc49 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:19.496659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:19.497613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.498042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.498492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.499343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:19.499795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:19.502114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb6d45-d782-4a38-b0a9-bd6476becffb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:19.507727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 429/880] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:19.513980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:19.535644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:19.619923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1437-875d-4723-9d15-771e9b1b808e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.620253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1437-875d-4723-9d15-771e9b1b808e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.620480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1437-875d-4723-9d15-771e9b1b808e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.622308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 430/881] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:19.625315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0663f1-01c2-4f8f-9f2a-234713fe8beb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:19.627826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.628121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.628398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.646410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:19.647678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:19.668877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:19.670319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.671055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.671541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.672322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:19.673672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:19.674805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:19.676669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:19.684423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 452/882] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:19.747849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 431/883] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:19.772545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:19.868971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:19.888575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6bf2e-a91e-43f0-9227-3aa35de2b4aa None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:19.927204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:19.928084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:19.928412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:19.928690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:19.929386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:19.930771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:19.943481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:19.944480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:19.945352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 453/884] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:19.950925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:20.060157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8eacf3-cbef-467e-871a-0c6027487cfc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:20.096474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:20.097523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.098025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.098490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.099396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:20.099890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:20.101895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:20.107603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 432/885] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:20.115855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:20.222431 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185ab73-4e6e-4503-8de0-3076c939633f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:20.256667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:20.257369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.257649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.257921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.258632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:20.258934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:20.260299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:20.266057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 454/886] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:20.272441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:20.277547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:20.380306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd63bb0-3f01-4505-ace5-d2bd8a263d2e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:20.416764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:20.417694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.418121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.418567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.419491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] RBAC: Adding query filter params (interface=public, service_id=f58134d5db9247449e26708c8c8d1bda, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:20.419945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:20.421484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024ff5a-82c3-4ee9-8e9c-26476a4bde90 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:20.431088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 433/887] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:20 2022] GET /identity/v3/endpoints?service_id=f58134d5db9247449e26708c8c8d1bda&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:20.436799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:20.454354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:20.548139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98127649-c499-4f7c-a008-4531fa936ba4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:20.582753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:20.583423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.583695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.583974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.584657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:20.586052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22da252-47cf-4033-81ca-b6e5472d90c1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:20.592584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 455/888] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:20 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:26:20.916021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141649e-8ffc-4d7a-bb5f-033ed3123617 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.916741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141649e-8ffc-4d7a-bb5f-033ed3123617 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.917257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141649e-8ffc-4d7a-bb5f-033ed3123617 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.919136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 434/889] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:20.924590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:20.925500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:20.926007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:20.944090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:20.945673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:21.016817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 456/890] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:21.040189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141649e-8ffc-4d7a-bb5f-033ed3123617 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.120855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.158255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141649e-8ffc-4d7a-bb5f-033ed3123617 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.192684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.193442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.193718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.193988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.205015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-72d81091-451b-43f3-bd8b-732b077d7877 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:21.213207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:21.214139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:21.215114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 435/891] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:21.220521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.237555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.294566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf42-cb8a-44e7-9a2f-c7f8f385b528 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.295084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf42-cb8a-44e7-9a2f-c7f8f385b528 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.295163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacf42-cb8a-44e7-9a2f-c7f8f385b528 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.296593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 436/892] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:21.303504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.303791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.304065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.322475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:21.323660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:21.335998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbe239-9c5b-4f02-b233-c895fd22e553 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.381959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.383148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.383931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.384668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.385640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:21.386528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.388696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.394936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 437/893] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:21.398476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 457/894] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:21.404038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.419211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.470965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.488819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.518851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f0f4c-9be0-42fe-a213-40f3e3872c20 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.527317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb933a-5e5b-4344-9734-696e90764325 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.566241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.567284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.567713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.568154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.568368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.569386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.569808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.570384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.571517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.573017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.579424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.580855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:21.587359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:21.588435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:21.589470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:21.592635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 458/895] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:21.608089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:21.609043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:21.609965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:21.609965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:21.609965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:21.609965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:21.610834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.610909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 438/896] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:21.610909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.717160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d5971-9467-4ebf-8709-9938f699832e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.721826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912e219-ee0b-4c08-90ce-b416f4e3289e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.729339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.753156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:21.756857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.758464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.758757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.759316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.759718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.760048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:21.760355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.760574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.761212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.761555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.762027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.762399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:21.762759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.764207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.769993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 459/897] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:21.774799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 439/898] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:21.777742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.781294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.895529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2a66-9c5f-4555-81c2-e2b2d1a516e6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.905614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018b10-3aca-48b0-a16f-ead217667b14 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:21.934945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.935751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.936215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.936352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.940978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:21.941688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.941970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.942245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.942952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:21.943259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.944180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:21.944617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e914-fe2e-4a71-a271-8f23bfdb1fb5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.945632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:21.949803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 460/899] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:21.951001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8a0c-94f8-4d61-8d62-b11398bb0cb7 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.951290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8a0c-94f8-4d61-8d62-b11398bb0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.951566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8a0c-94f8-4d61-8d62-b11398bb0cb7 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.952896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 461/900] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:21.958314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8a0c-94f8-4d61-8d62-b11398bb0cb7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3ae5df6c-0588-4257-b8a1-6bf33d1e3062 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:21.961144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:21.964184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 440/901] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:21.966949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:21.968685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:21.981152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:21.982301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:22.008126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.029402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.056532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 441/902] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:22.057385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.088356 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8a0c-94f8-4d61-8d62-b11398bb0cb7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.134635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.135356 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.135570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.136104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.136885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] RBAC: Adding query filter params (interface=public, service_id=ed41031673624fe6b15b428ef01c9fe9, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:22.137225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.138573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.147408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 462/903] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:21 2022] GET /identity/v3/endpoints?service_id=ed41031673624fe6b15b428ef01c9fe9&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:22.152534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.176549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb5467-4191-4ce3-af9c-ca60f40789dc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.212595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.213296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.213581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.213858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.214708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:22.215000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.216467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.234318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 442/904] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:22.235166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.256136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.267564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbeb30-74b6-410a-b45b-58607fbffbf4 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.291305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.304757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.305719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.306200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.306647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.307597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.309225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.325599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 463/905] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:22 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:22.326757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.354317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581184c4-92bb-49be-b10a-cb07b3520e4b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.415062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.416402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.416871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.418045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.419306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.421275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.430683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 443/906] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:26:22.461861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bc3f5-5e3c-45aa-9c00-cc41d06a7e20 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.505078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.505783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.506064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.506345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.567503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.589162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.590672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd105f03-b0b4-4c53-93e3-b75f8e304f8b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.699641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 464/907] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:22.706072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.765979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730e54-aade-4366-818d-b6b04756ddeb None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.766797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730e54-aade-4366-818d-b6b04756ddeb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.767012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730e54-aade-4366-818d-b6b04756ddeb None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.768670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 465/908] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:22.774047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.774335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.774858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.791995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:22.793653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:22.798834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.826950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100fb03-3043-480b-90a7-264b6047e112 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:22.871972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b766-c041-466a-88bc-369240629415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:22.873023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b766-c041-466a-88bc-369240629415 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:22.873468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b766-c041-466a-88bc-369240629415 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:22.873749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b766-c041-466a-88bc-369240629415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:22.876810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 466/909] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:22.890915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b766-c041-466a-88bc-369240629415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:22.893643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b766-c041-466a-88bc-369240629415 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:22.900339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:22.916337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5b37b766-c041-466a-88bc-369240629415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:22.917031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:22.918307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:22.919375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:22.919375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:22.919375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:22.919375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:22.919375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 444/910] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:22.925387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b766-c041-466a-88bc-369240629415 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.013593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f8bb-2a9c-4627-adbc-a717f065ea26 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.052225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.053040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.053359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.053634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.054316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.055853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.058140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b766-c041-466a-88bc-369240629415 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:23.068524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:23.069610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 23:26:23.070442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:23.073572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 467/911] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:23.076159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.089025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:23.099756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.100520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.100865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.101222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.102153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:23.102541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.104023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.118384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 445/912] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:23.123811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.164304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:23.193477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f3ca7-50b9-409a-beee-4bfc0494b701 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.237385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.238064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.238350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.238630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.239609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:23.239919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.241729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.249218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 468/913] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:23.254198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.261764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4a82a-5701-4318-b268-a565cbebf7f7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.297397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.298642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.298923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.299199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.306384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.307815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:23.322739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:23.323648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:23.324557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:23.329835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 446/914] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:23.330740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.380201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f4d0c-5d61-47bd-8f46-16e88524b795 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.393734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:23.417219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.417844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.418025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.418306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.419013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:23.419317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.420689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.431096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 469/915] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 23:26:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:23.431938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.435567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:23.451608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c4c14-f8bd-4c31-acc0-358595ae093a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.489623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.490645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.491133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.491609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.492595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:23.493132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.494776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.507880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 447/916] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:23.518150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:23.555618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc06db-95b3-4e08-bbd6-f9d356e59dd9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.594376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.595510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.595823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.596090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.596933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.598387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02cf39-5f24-4212-bda3-97015c6dca0e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.623160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 470/917] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:23.649993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f06c91-c395-4d6a-8f58-f778d9f8d1c7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:23.667164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:23.704381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:23.705072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:23.705379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:23.705658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:23.706503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] RBAC: Adding query filter params (role.id=9e7f3af2884d4e9ca5b7bef4587f624a, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=1352bc3b2bcd474b920ff7cd151e445a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:23.706822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:23.708283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272f12-ffd4-44b7-a868-7ea07b4db324 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:23.715368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 448/918] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:23 2022] GET /identity/v3/role_assignments?user.id=1352bc3b2bcd474b920ff7cd151e445a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=9e7f3af2884d4e9ca5b7bef4587f624a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:24.558135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0256-f472-421b-9b2e-4af9bde50f9d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.559189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0256-f472-421b-9b2e-4af9bde50f9d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.559703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0256-f472-421b-9b2e-4af9bde50f9d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.561552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 471/919] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:24.567511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.568325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.568817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.586236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:24.587751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:24.591319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ae91-e82d-4cd3-92b6-7009ee01d540 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.591824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ae91-e82d-4cd3-92b6-7009ee01d540 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.592322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ae91-e82d-4cd3-92b6-7009ee01d540 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.594152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 472/920] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:24.602140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.602678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.603167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.623156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:24.624942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:24.673604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 449/921] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:24.691228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:24.694493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:24.713613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 473/922] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:24.731894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:24.803635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec879-f85a-4217-a904-784d663c8820 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:24.817711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:24.841088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ea20b-0e88-4bb8-9c7d-9620aecc2f70 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:24.842302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:24.843151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.843434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.843712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.844480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:24.846758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:24.859382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:24.861438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:24.862358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:24.863161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 450/923] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:24.869080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:24.895003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:24.895825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:24.896108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:24.896377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:24.897378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:24.898766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:24.914723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:24.915874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 23:26:24.916713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:24.921272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 474/924] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 23:26:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:24.923445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:24.993672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.006554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfc3d-c418-4176-b48e-38b89e45e73a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.042104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc790e-706b-44bf-b7a1-a698be656381 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.042896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.043859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.044356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.044834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.045795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:25.046318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.048527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.058599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 451/925] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:25.059791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.079034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.079688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.079935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.080211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.080918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:25.081258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.082628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.091612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.092389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 475/926] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:25.093868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.173494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df68b5-ec82-4efe-8bd4-211260fae4db None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.208696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e282ca-a05f-4cc8-bdbf-9c80410205a9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.210267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.211316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.211830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.212316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.213338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:25.213850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.215437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.221018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 452/927] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:25.227115 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.232244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.254509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.255191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.255477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.255816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.257099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:25.257461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.259160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.271396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 476/928] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:25.272916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.349904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.361509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5183d-a8d9-47da-bbe8-a64afc290a85 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.402850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625978f-3163-4fd2-8ab7-fff50ea9c509 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.409074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.409800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.410087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.410366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.411332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] RBAC: Adding query filter params (interface=public, service_id=f4990867ccb049c587fde61d2aa3bb4f, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:25.411651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.413641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.421232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 453/929] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:25 2022] GET /identity/v3/endpoints?service_id=f4990867ccb049c587fde61d2aa3bb4f&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:25.426618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.452021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.453230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.454295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.454605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.455621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.457246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129bf35-ac46-4de0-939e-66f2dcad7125 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.493241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 477/930] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:26:25.561541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203227e5-caf9-4e36-a3c0-925912967977 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:25.608079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:25.608840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.609127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.609454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.610162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:25.611739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c0df4-3112-4922-a51a-908d5e58eea2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:25.619290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 454/931] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:25 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:26:25.790797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20051-0519-4280-8f1f-d4fa64dffa78 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.791936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20051-0519-4280-8f1f-d4fa64dffa78 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.792441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20051-0519-4280-8f1f-d4fa64dffa78 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.794361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 478/932] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:25.799366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.799659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.799939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.812904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f300-35b8-4f42-b178-d5e2d21073b2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.813305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f300-35b8-4f42-b178-d5e2d21073b2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.813594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35f300-35b8-4f42-b178-d5e2d21073b2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.815169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 479/933] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:25.817924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:25.819182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:25.820239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:25.820530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:25.820818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:25.831795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.843412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:25.845572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:25.878840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:25.900021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 455/934] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:25.923801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:25.924465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 480/935] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:25.947800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.035977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d731da-492a-4e23-9abb-37d4e2c6aa29 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.061063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421082af-3cf8-4fbc-8514-4ebc20ca75ab None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.080364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.081718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.082166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.082724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.097458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:26.107959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:26.108918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:26.110548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:26.113361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 456/936] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:26.118949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.121871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.122872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.123222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.123570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.124404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.126028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.127712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING keystone.server.flask.common [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 23:26:26.130038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:26.146576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.sql.core [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 23:26:26.146576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 23:26:26.146576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [parameters: {'id': '64e3dd495b2b49e9a8d579254a05f5ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 23:26:26.146576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80238) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64e3dd495b2b49e9a8d579254a05f5ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64e3dd495b2b49e9a8d579254a05f5ea. Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:26:26.155220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 23:26:26.156124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application yield resource Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise self.value Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application session.commit() Jul 21 23:26:26.158277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.session.flush() Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application compat.raise_( Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 23:26:26.159349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 23:26:26.160461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application result.read() Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:26:26.161440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [parameters: {'id': '64e3dd495b2b49e9a8d579254a05f5ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.163419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:26.165149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64e3dd495b2b49e9a8d579254a05f5ea. Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 481/937] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Jul 21 23:26:25 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:26.167463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.194085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:26.252608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d15f-a66d-471f-97f0-3e8fc764e3d4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.280320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0df97-59da-4a69-a464-58551af776c5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.290237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.291057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.291347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.291667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.292573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:26.292887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.294299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.304391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 457/938] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:26.310571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.319793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.320780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.321128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.321500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.329781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.331520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:26.347241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:26.348984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.350626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 482/939] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:26.358488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.411106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:26.434365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835a7ec-0e10-4faa-97a5-b48354c0f8f3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.467809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:26.476265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.477272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.477870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.478168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.488276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca85372-5c6e-4f8c-aa91-e77db6709317 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.492284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.493909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:26.517321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:26.518438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:26.519379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:26.519379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:26.519379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:26.519379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:26.519379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 458/940] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:26.524303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.535967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.537409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.537904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.538798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.540119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:26.540644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.543293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.577440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 483/941] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:26.639852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab15f5-3754-4677-b4f1-fe089699ade2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.667870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:26.683722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.684394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.684669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.684942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.685783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:26.686084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.687484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.706869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 459/942] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:26.708422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.821482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4887bf-1e78-476d-a223-3dfa5f56d429 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:26.856668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:26.857547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:26.857830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:26.858211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:26.867707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:26.869147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:26.884395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:26.885421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:26.886640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:26.890582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 484/943] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:26.892263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:26.994653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a156b-8ebe-4845-9db4-e08606ba5391 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.029059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.029759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.030035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.030304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.031132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:27.031434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.033405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.055362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 460/944] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:27.056764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.061452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:27.160577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6f0b9-051c-4e0f-a560-b847f68065a6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.196225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.197422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.197915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.198414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.210668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.212441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:27.230862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:27.231793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:27.232678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:27.232678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:27.232678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:27.232678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:27.235462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 485/945] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:27.241127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.284015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:27.353160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b974629-1b00-4e6f-b1b4-4bad28a3561d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.388612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.389302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.389584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.389855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.390568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:27.390869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.392743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.409302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 461/946] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:27.410904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.472651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:27.525493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e99afa-536d-43a7-b056-8a96c1d5dc24 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.567489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.568658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.569145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.569662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.577157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.579433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a5a2de1b-3a7c-4b66-b4ae-3fdad56b08a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:27.594510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:27.595430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:27.596348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:27.598854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 486/947] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:27.606418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.681840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c725-a754-4c99-aa09-30fe1f0dc917 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.682152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c725-a754-4c99-aa09-30fe1f0dc917 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.682395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899c725-a754-4c99-aa09-30fe1f0dc917 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.684001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 487/948] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:27.689915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcfd39-7092-44e1-acc3-2a934f9b966f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.690199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcfd39-7092-44e1-acc3-2a934f9b966f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.690476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcfd39-7092-44e1-acc3-2a934f9b966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.709083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:27.709953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4adcfd39-7092-44e1-acc3-2a934f9b966f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:27.711694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4adcfd39-7092-44e1-acc3-2a934f9b966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:27.712425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39c6ce-c436-4562-a11b-28c450c8ee2a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.753299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.754099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.754384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.754662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.755452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:27.755756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.757201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc6ca0-0105-43fd-b61f-1a1939b16e64 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.772231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 462/949] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:27.775236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c75d9-1df4-43e1-be81-802dfee63502 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.775523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c75d9-1df4-43e1-be81-802dfee63502 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.775799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c75d9-1df4-43e1-be81-802dfee63502 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.778039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 463/950] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:27.778732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c75d9-1df4-43e1-be81-802dfee63502 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.794821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 488/951] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:27.794821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.794821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.794821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.814911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:27.816111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:27.861427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:27.889052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 489/952] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:27.889986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:27.910757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c75d9-1df4-43e1-be81-802dfee63502 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:27.949772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:27.950657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:27.950936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:27.951206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/1352bc3b2bcd474b920ff7cd151e445a/roles/9e7f3af2884d4e9ca5b7bef4587f624a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:27.953466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=1352bc3b2bcd474b920ff7cd151e445a, role_id=9e7f3af2884d4e9ca5b7bef4587f624a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:27.955925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:27.971052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 464/953] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:27 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/1352bc3b2bcd474b920ff7cd151e445a/roles/9e7f3af2884d4e9ca5b7bef4587f624a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:26:27.972860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.023521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:28.034264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e3d48-567f-4fbd-8ece-add407fe4d9b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.115906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.116648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.116931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.117217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.119423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.120849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:28.162187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:28.163279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:28.164307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 490/954] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:28.175186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.223167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2718a31-1fbf-4467-828b-53feaea7ccef None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.241222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:28.270707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.271766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.272214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.272900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.273737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.275905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:28.295108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:28.296348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:28.298018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:28.301027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 465/955] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:28.306861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.352441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab13f8-52ad-478a-8849-026d91fa3699 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.414551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.415652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.416151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.417726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.418521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:28.419960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.422177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.436480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 491/956] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:28.439658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.463595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:28.484551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1af92f-76e0-4f46-8b89-0ae4b1c820a3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.522958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.523626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.523967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.524243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.525108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:28.525442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.526997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.537603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 466/957] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:28.540036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.562468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd834c-583b-41a8-8540-b8feb9827967 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.566129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:28.603221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.604116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.604492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.604944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.605869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:28.606259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.607707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.613088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 492/958] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:28.667878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242455-9c02-4405-a1b5-400eb725fdd7 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.706488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.707168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.707451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.707727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.708448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:28.708755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.710182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93850977-a0b3-4d21-b917-7eae57b9079e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.716267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 467/959] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:28.722162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:28.838428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00164dd9-d7ba-450b-bd9a-47a564aca805 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:28.874762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:28.876271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.876784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.877355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.878309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:28.879867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33123955-f9db-4a77-a007-72cc02ce7e73 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:28.900659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 493/960] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:28.962151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9c10-ebb1-468c-b25f-02e7cc1320bb None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.962338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9c10-ebb1-468c-b25f-02e7cc1320bb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.962598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b9c10-ebb1-468c-b25f-02e7cc1320bb None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.964257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 468/961] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:28.970503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:28.970920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:28.971053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:28.989554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:28.990802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:29.010075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:29.074384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 494/962] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:29.103121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9c10-ebb1-468c-b25f-02e7cc1320bb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:29.117809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:29.215432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b9c10-ebb1-468c-b25f-02e7cc1320bb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:29.253106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:29.253821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:29.254408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:29.254690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:29.255403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:29.256837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:29.258183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING keystone.server.flask.common [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 23:26:29.272099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.sql.core [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 23:26:29.272099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 23:26:29.272099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [parameters: {'user_id': 'a6c0d6e4693a4b1ab1c85b08cdaacea2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 23:26:29.272099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80239) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jul 21 23:26:29.289673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:26:29.290681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application yield resource Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application next(self.gen) Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise self.value Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application session.commit() Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 23:26:29.291644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.session.flush() Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application compat.raise_( Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 23:26:29.292574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 23:26:29.294586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application conn.query(q) Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application result.read() Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 23:26:29.296914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a6c0d6e4693a4b1ab1c85b08cdaacea2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:29.301983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 23:26:29.303892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:29.309076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 469/963] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 23:26:29 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:29.310063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:29.406869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469c22b-79bf-4da1-987e-c2c7a819fc46 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:29.443838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:29.444640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:29.444915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:29.445199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:29.452711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:29.455390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-71c1bcdd-60eb-4cbd-9982-72d122be31b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:29.471009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:29.473297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:29.475620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 495/964] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:29.481285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:29.555640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:29.588288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039e77-f151-4a69-b454-d0a4eb7f0fdb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:29.624013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:29.624727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:29.625008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:29.625339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:29.626669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:29.627027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:29.628650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61675dca-cb68-41e7-b1ed-8e69db7ddc7e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:29.671172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 470/965] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 23:26:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:30.154577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d394e-3b6f-4911-a7fd-f67c7e5c315e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.155119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d394e-3b6f-4911-a7fd-f67c7e5c315e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.155119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d394e-3b6f-4911-a7fd-f67c7e5c315e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.157231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 496/966] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:30.162323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.162744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.162920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.180532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:30.182069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:30.253231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 471/967] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:30.274949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d394e-3b6f-4911-a7fd-f67c7e5c315e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.288119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:30.380970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d394e-3b6f-4911-a7fd-f67c7e5c315e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:30.415040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:30.415846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.416126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.416398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.426669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:30.434680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:30.435615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:30.436475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:30.441598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 497/968] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:30.442838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.506085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:30.549003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b34080-f210-48d2-a219-9f62c7be6d14 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:30.583758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:30.584428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.584711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.584987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.585749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:30.586054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:30.587414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:30.600891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 472/969] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:30.601888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.673048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:30.705486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871198d-6683-4924-a719-ff8d9a504b44 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:30.740388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:30.741210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.741507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.741780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.753396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:30.754859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1dd07036-bdda-4c88-b68d-7577490bd746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:30.773150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:30.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:30.779625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:30.779625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:30.779625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:30.779625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:30.779625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 498/970] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:30.780258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.785048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8370-a576-4b0b-9c20-dadc77375bb2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.785381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8370-a576-4b0b-9c20-dadc77375bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.785664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8370-a576-4b0b-9c20-dadc77375bb2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.787147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 499/971] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:30.791969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.792256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.792536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.810044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:30.811287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:30.882073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 500/972] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:30.884297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ba01a-165f-41ae-82fa-5ff91c4e5440 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:30.905755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.908130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:30.921381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:30.922048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:30.922867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:30.923194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:30.923940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:30.924221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:30.925626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:30.942042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 473/973] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:30.943127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:30.967376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.017071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643ee4-4618-494b-96fc-985d2ae2e66a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.051976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.052643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.052924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.053217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.053952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.055318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888cda5-3455-4103-ac02-00d31850aa3b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.056362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960105d-bf97-4208-b638-7d0b187ac96b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.077231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 501/974] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:30 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:26:31.084698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fec3-6cac-4241-80b1-fdf25c69497b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.085025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fec3-6cac-4241-80b1-fdf25c69497b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.085300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786fec3-6cac-4241-80b1-fdf25c69497b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.087560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 502/975] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:31.095689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.096427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.097397 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.112632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.113524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.113806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.114076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.122081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:31.123465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.123713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:31.124943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:31.143678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:31.144715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:31.145676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 474/976] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:26:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:31.151030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.196562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.207623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 503/977] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:31.231391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.272138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04973f-b430-4e44-a0da-cb216e1c04d2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.276532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.309844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.310526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.310812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.311090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.311929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:31.312265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.314282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.331855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 475/978] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:31.337317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.343479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2563-f880-4a99-a3b1-58e04024e6cb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.379500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.380311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.380595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.380874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.381561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.382929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:31.395573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:31.396803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:31.397834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 504/979] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:31.402891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.446008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.452565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216da3f-4661-4198-b850-06479dbb9a5c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.489435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.490098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.490381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.490900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.509264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db0473-239d-4518-a376-9d2358cc9b62 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.517635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.548175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.548944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.549216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.549485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.550184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:31.550489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.551856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.561686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 505/980] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:31.562698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.575718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.577176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.669180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70ed37-aab4-44c0-b77c-a673f1b16d8c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.689431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.696709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 476/981] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:31.701946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.706793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.707408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.707692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.707968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.708684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:31.708990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.710415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.715754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 506/982] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:31.722209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.758155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.808078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48050f-503b-4c59-be4d-57902d0c005e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.829928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520685eb-0c7c-4466-9f9c-9499015fbd0e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.843658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.845016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.845406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.845686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.855866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.857377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.865463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:31.866396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:31.866876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:31.867336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:31.868310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] RBAC: Adding query filter params (interface=admin, service_id=f4990867ccb049c587fde61d2aa3bb4f, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:31.868792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:31.870416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:31.874927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:31.876128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:31.877035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:31.877035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:31.877035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:31.877035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:31.877035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 477/983] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:31.877607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 507/984] 10.222.0.57 () {56 vars in 1249 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/endpoints?service_id=f4990867ccb049c587fde61d2aa3bb4f&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:31.881702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.883015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:31.935491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.981397 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:31.985862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02a744-4856-4591-a5c2-b1ac15939318 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:31.992540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25546722-b2e0-4997-a0f7-9826414e0f0c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:32.020138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:32.020812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:32.021098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:32.021409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:32.022102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:32.023481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:32.030175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 508/985] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:26:32.044630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:32.045377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:32.045664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:32.045942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:32.046694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:32.047005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:32.049397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:32.062840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 478/986] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:32.068222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:32.196704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b10dc-e159-470e-82e4-2ea001149499 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:32.234074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:32.235533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:32.235767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:32.235985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:32.243110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:32.244548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:32.259130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:32.260060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:32.261648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 509/987] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:32.266761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:32.369514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d66d7-15f1-4172-8f57-0634082aec23 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:32.378942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:32.405427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:32.406142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:32.406445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:32.407311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:32.408085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:32.408397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:32.409848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264eb9a-b4a2-46cb-a469-04c96f479dc1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:32.422432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 479/988] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:32.428218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:32.452761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:32.533166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30bef7-5d5d-4ea8-9f2b-8aaaff6ac7ea None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:32.566948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:32.567613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:32.567898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:32.568174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:32.569012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] RBAC: Adding query filter params (role.id=9e7f3af2884d4e9ca5b7bef4587f624a, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=1352bc3b2bcd474b920ff7cd151e445a) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:32.569355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:32.570802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69c47c-b206-4d8f-ac26-85a0aded8e55 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:32.584744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 510/989] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:32 2022] GET /identity/v3/role_assignments?user.id=1352bc3b2bcd474b920ff7cd151e445a&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=9e7f3af2884d4e9ca5b7bef4587f624a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:33.153253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db93a-7a3c-4db2-a8ca-8611735c1ac4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.153585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db93a-7a3c-4db2-a8ca-8611735c1ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.153820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2db93a-7a3c-4db2-a8ca-8611735c1ac4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.155348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 480/990] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:33.161301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.161608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.161868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.179937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:33.181139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:33.251287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 511/991] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:33.273817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2db93a-7a3c-4db2-a8ca-8611735c1ac4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:33.378154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2db93a-7a3c-4db2-a8ca-8611735c1ac4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:33.414009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:33.414803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.415094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.415372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.416015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:33.417405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:33.429559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:33.430552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:33.431405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:33.433506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 481/992] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:33.436669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:33.454478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:33.537977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838cc62-d92d-4e11-a519-a01f00ea8427 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:33.571662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:33.572331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.572616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.572896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.573638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:33.573948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:33.575313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:33.584894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 512/993] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:33.586331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:33.627316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:33.699491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc214696-3487-4c16-a24a-9b8a48aced6c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:33.736131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:33.736802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.737087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.737391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.738125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:33.738433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:33.739797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:33.745098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 482/994] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:33.751633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:33.836382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:33.856752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271948c-a2d8-4158-b4f8-d4840b3582ed None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:33.891778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:33.892433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:33.892721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:33.892997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:33.893820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] RBAC: Adding query filter params (interface=public, service_id=513c1ac49643499680da8f24e2e78e25, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:33.894137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:33.895508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475b8e-f017-4472-86bc-7dd0699a779b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:33.900684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 513/995] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:33 2022] GET /identity/v3/endpoints?service_id=513c1ac49643499680da8f24e2e78e25&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:33.906021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.001437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:34.008300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90749-8b4f-47e0-bcd5-7d2999e24a89 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.042209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.042880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.043163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.043445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.044129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.045587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f7d59-d5ba-4613-9327-441237a3062c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.060640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 483/996] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:33 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:26:34.106593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa6ad-c437-4aee-86c8-85c69117c629 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.106887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa6ad-c437-4aee-86c8-85c69117c629 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.107155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa6ad-c437-4aee-86c8-85c69117c629 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.108707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 514/997] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:34.114616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.114918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.115187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.133305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:34.134529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:34.211508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 484/998] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:34.234222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfa6ad-c437-4aee-86c8-85c69117c629 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.336922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfa6ad-c437-4aee-86c8-85c69117c629 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.370544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.371354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.371639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.371916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.372573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.373965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:34.386711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:34.387752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:34.389073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 515/999] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 23:26:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:34.394911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.489804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:34.501135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b95e6-545e-4a96-a8da-93c4d1f169e4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.536787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.537492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.537778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.538052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.538779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:34.539085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.541327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324c166-eb21-4b1b-84f5-5bb39e50335c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.545877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 485/1000] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:34.551806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.563998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:34.655341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc723-bb1d-466a-be8e-76e3bc3acd06 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.663938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06b73-28c9-46ad-b589-6b4a60ece2ea None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.664223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06b73-28c9-46ad-b589-6b4a60ece2ea None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.664498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e06b73-28c9-46ad-b589-6b4a60ece2ea None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.666035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 486/1001] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:34.670604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.670890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.671170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.687806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:34.689000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:34.697288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.697961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.698240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.698518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.699224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:34.699527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.700887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.707203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 516/1002] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 23:26:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:34.714120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.765247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 487/1003] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:34.788221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:34.796113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:34.829489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2083-b8bd-45b6-ba00-6d63f1731866 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.865593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.866251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.866542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.866813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.867557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.868920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.877211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:34.897223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 517/1004] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:34.905818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f15a38-72c4-481e-a0dc-32ceca85f93e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:34.954009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:34.955438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:34.955718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:34.955986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] PATH_INFO: `/v3/services/image` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:34.956644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:34.958063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:34.971125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:34.972229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:34.973309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 488/1005] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 23:26:34 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:34.978572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:35.091808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c399698-6e53-4eb2-8984-c5138a54f94f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:35.122355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:35.128895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:35.130154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:35.130814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:35.131466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:35.132182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:35.132490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:35.133889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4f5fc-02b0-4f93-b4bf-41c429dca3e7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:35.144024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 518/1006] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:35.145594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:35.251407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b27f71-912e-4796-9f74-42c25ee7ea2a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:35.286295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:35.287214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:35.287639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:35.288050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:35.288882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] RBAC: Adding query filter params (type=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:35.289371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:35.290907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150a300-a81c-4972-a71c-5d46024ad952 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:35.295508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 489/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:36.136281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022bd2-600a-4139-b7e1-a7fd3714db65 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.136789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022bd2-600a-4139-b7e1-a7fd3714db65 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.136883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd022bd2-600a-4139-b7e1-a7fd3714db65 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.138404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 519/1008] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:36.143871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.144281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.144469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.161654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:36.162817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:36.164891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:36.238415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 490/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:36.260925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022bd2-600a-4139-b7e1-a7fd3714db65 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:36.363295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd022bd2-600a-4139-b7e1-a7fd3714db65 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:36.398213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:36.399017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.399293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.399560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.400208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:36.401628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:36.413803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:36.414822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 23:26:36.415701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:36.417520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 520/1010] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:36.420971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:36.522691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ef06f-a7f4-4b6c-865e-918add6bb967 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:36.556383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:36.557127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.557366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.557645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.558347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:36.558654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:36.560018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:36.569934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 491/1011] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:36.571540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:36.634059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:36.677557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57b4a2-6457-49f4-b396-9061c790ba7c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:36.711219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:36.711876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.712153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.712423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.713114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] RBAC: Adding query filter params (type=compute) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:36.713443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:36.714794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaf0c8-b651-4511-a19c-b56f73d712df None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:36.719748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 521/1012] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 23:26:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:36.725296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:36.728133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:36.827418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7c0e6-8fef-4ac9-a117-a5beaa6e2220 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:36.862681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:36.863338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.863616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.863889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.864664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:36.866046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3c82-5c48-4b0b-803b-4e0809022e1b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:36.893316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 492/1013] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:36.987221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da81abf-bb64-4753-8c07-d2eadfd384d1 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.987563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da81abf-bb64-4753-8c07-d2eadfd384d1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.987844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da81abf-bb64-4753-8c07-d2eadfd384d1 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:36.989291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 522/1014] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:36.995114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:36.995427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:36.995680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.014547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:37.015871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:37.075276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:37.097149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 493/1015] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:37.120952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da81abf-bb64-4753-8c07-d2eadfd384d1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:37.230988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da81abf-bb64-4753-8c07-d2eadfd384d1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:37.255697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:37.267344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:37.268148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:37.268432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:37.268710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.269901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:37.271351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa1dd3-7043-4f6b-8bd5-0841337e805c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:37.273155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 523/1016] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:37.278993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:37.332800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002cad-9947-4496-86fd-8b9278d3d674 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:37.333133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002cad-9947-4496-86fd-8b9278d3d674 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:37.333392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002cad-9947-4496-86fd-8b9278d3d674 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.334758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 524/1017] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:37.339569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:37.339857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:37.340138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.357603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:37.359206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:37.383243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695a929-167a-4b65-9def-47e5ee83f4ed None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:37.419337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:37.420000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:37.420281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:37.420560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.421283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:37.423321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8beeb-2c50-4218-8181-dc27b2a67a30 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:37.432639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 525/1018] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:37.458196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 494/1019] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:37 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:37.458436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:37.570137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ae53c-3747-4ca6-9424-0ae1d5550a52 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:37.595489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:37.614197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:37.614895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:37.615182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:37.615456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:37.616197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:37.617654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70210dcb-dcbd-4ee6-9075-ab0a5cb66782 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:37.634447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 526/1020] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:26:37 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:39.088172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7e21-2dc3-47e3-a71a-b61524461a85 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.088705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7e21-2dc3-47e3-a71a-b61524461a85 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.088705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f7e21-2dc3-47e3-a71a-b61524461a85 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.090431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 495/1021] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:39.096226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.096670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.096850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.114501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:39.115710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:39.192108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 527/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:39.214919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f7e21-2dc3-47e3-a71a-b61524461a85 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.254395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:39.324018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f7e21-2dc3-47e3-a71a-b61524461a85 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:39.357843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:39.358581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.358865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.359143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.370068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:39.378179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:39.379104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:39.379945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:39.384390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 496/1023] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:39.385634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.484854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a5b1c-cee0-4fa9-b506-a4a113f89cce None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:39.494148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:39.522005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:39.522685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.522969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.523249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.523997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:39.524305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:39.525712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4696a2-cba8-45b5-b3a5-9e012fe415e9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:39.539061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 528/1024] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:39.540861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.543439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1112f2-e049-4119-b1f2-03ff75356f70 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.543932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1112f2-e049-4119-b1f2-03ff75356f70 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.544216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1112f2-e049-4119-b1f2-03ff75356f70 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.545801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 529/1025] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:39.553458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.553746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.554027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.570960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:39.572145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:39.643764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 530/1026] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:39.647949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:39.654306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4ef1-a296-4a75-8134-f9841e30026d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:39.668562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.690982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:39.691779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.692064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.692340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.702346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:39.704021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-56b6ea29-1205-40a9-9ad5-b96b19282194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:39.721712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:39.722795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:39.723714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:39.723714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:39.723714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:39.723714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:39.723714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 497/1027] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:39.724121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69d27-6e7a-4465-a094-22681e4de26a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.724400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69d27-6e7a-4465-a094-22681e4de26a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.724686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a69d27-6e7a-4465-a094-22681e4de26a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.726155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 498/1028] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:39.728678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69d27-6e7a-4465-a094-22681e4de26a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.774919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:39.778234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8eca6-4da5-4d99-b3c6-9c19f0e7f7ea None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:39.814219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:39.815013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.815303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.815576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.816750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:39.818219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a2e3-ce2d-403c-97f1-5bcae6ff087d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:39.819850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 531/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:39.821080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.821395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.821675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.834905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a69d27-6e7a-4465-a094-22681e4de26a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:39.839716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:39.840891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:39.869755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:39.870409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:39.870685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:39.870955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:39.871664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:39.871959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:39.873331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:39.884560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 499/1030] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:39.885615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.900000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:39.911221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 532/1031] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:39.912064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:39.989978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f702-2390-463b-9c71-0a31c1f7dc37 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.012961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.017910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d7ec6-110a-43ba-b2d8-a5962f30341a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.024867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.025599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.025884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.026159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.026871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.028298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.047974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 500/1032] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:26:39 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:40.048790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.053933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.054763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.055049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.055338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.064882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.066560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:40.083387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:40.084610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 533/1033] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:26:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:40.094652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.135848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.187860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa23b10-07b3-4958-81b4-97524af3dacd None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.220882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2ce12-7ec9-4aa9-bdd8-dbcc08947841 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.227741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.228534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.228810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.229086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] PATH_INFO: `/v3/services/image` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.229766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.231141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:40.243250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:40.244264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:40.245242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:40.246016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 501/1034] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:40.252027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.262783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.263472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.263846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.264126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.264981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:40.265348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.267402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.286394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 534/1035] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:40.291900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.309999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.380407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f23485-e2fc-4667-95f4-bad9018af2fc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.396985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa214217-33e7-4c37-a2c2-52b4b6e7b9e7 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.408837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.417234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.417908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.418194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.418907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.419627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] RBAC: Adding query filter params (name=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:40.420097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.421505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.432118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 502/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:40.433147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.439009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.439842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.440161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.440434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.517534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.519332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.536857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.538056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f4406-d5c1-4cc3-9a12-487816934572 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.576607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.577292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.577574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.577851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.579334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] RBAC: Adding query filter params (type=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:40.579738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.581098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.585987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 503/1037] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:40.592039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.630009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 535/1038] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:40.635886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.654836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.702032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f1f9-e40b-403d-8875-3c4d06c8f94b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.740496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.741152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.741466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.741740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.742516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] RBAC: Adding query filter params (interface=public, service_id=5c02bd5b55e64c4a8dde45a24e2f9f5c, region_id=RegionOne) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:40.742823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.745463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff52d01-2a32-44c1-b5f5-5d7a253c537b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.746170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.753069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 504/1039] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/endpoints?service_id=5c02bd5b55e64c4a8dde45a24e2f9f5c&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:40.758918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.770594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.790458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.791644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.792138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.792583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.804010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.805489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:40.823771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:40.824836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:40.825990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:40.825990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:40.825990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:40.825990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:40.827574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 536/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:40.834112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:40.871167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e491-5dd8-4516-b62e-3319994f5e9a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.894075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:40.910220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.911521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.911521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.911521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.912107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.913500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:40.920312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 505/1041] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:26:40.943930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52c3da-c992-4f5b-b35c-acca7a0a38a3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:40.983622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:40.984692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:40.985097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:40.985509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:40.986348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:40.986757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:40.988255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:41.002609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 537/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:41.008452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:41.128956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9403-fa25-46ea-8c84-89bfd1f56b06 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:41.164266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:41.165069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:41.165380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:41.165654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:41.172707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:41.174176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:41.188848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:41.189833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:41.190726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:41.191634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 506/1043] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:41.196241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:41.227952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:41.303582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4530d-4f71-4a66-851c-3bc3bd3c216c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:41.336633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:41.337316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:41.337598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:41.337925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:41.338702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:41.339055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:41.340472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76770b52-3f15-4408-9588-027543e5d46f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:41.357472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 538/1044] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:41.358987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:41.409995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:41.467667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea720a5-0eba-4b27-89ae-6034221f8a8a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:41.503463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:41.504114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:41.504393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:41.504664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:41.505525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] RBAC: Adding query filter params (role.id=9e7f3af2884d4e9ca5b7bef4587f624a, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:41.505840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:41.507374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d111fc-9283-4fd8-8f21-a857e56769f9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:41.521299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 507/1045] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:41 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=9e7f3af2884d4e9ca5b7bef4587f624a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:42.154319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c090d-138d-4fd6-95ba-f59c225c189c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.154631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c090d-138d-4fd6-95ba-f59c225c189c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.154886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c090d-138d-4fd6-95ba-f59c225c189c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.156499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 539/1046] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:42.161475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.161766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.162040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.179782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:42.180981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:42.253227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 508/1047] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:42.273711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c090d-138d-4fd6-95ba-f59c225c189c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:42.365606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:42.380100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c090d-138d-4fd6-95ba-f59c225c189c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:42.415162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:42.415967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.416250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.416523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.426890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:42.434591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:42.435502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:42.436335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:42.441330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 540/1048] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:42.442670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:42.482733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:42.545157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1daa80-1369-49d9-9bd3-f4eddb955f1e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:42.580433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:42.581110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.581419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.581698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.582449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:42.582756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:42.584127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:42.597459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 509/1049] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:42.598973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:42.702220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b24cef-921b-4bae-9574-90ecd73d7db3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:42.735620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:42.736494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.736778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.737056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] PATH_INFO: `/v3/users/f7cf574216c548f5b4091026e079d938` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.750992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] RBAC: Authorizing `identity:get_user(user_id=f7cf574216c548f5b4091026e079d938)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:42.752457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05be1e8-ffb4-4fe4-8cf2-91c948448047 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:42.761203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 541/1050] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:42 2022] GET /identity/v3/users/f7cf574216c548f5b4091026e079d938 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:42.761363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:42.860998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:42.865287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cb2fd-0e17-430b-93bd-86090e3961d5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:42.899475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:42.900133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.900419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.900699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.966057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47a7f-7e53-460b-bf4a-37bea19ab0bb None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.966360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47a7f-7e53-460b-bf4a-37bea19ab0bb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.966529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47a7f-7e53-460b-bf4a-37bea19ab0bb None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.967889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 542/1051] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:42.969631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:42.971109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:42.972750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:42.973037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:42.973351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:42.987219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:42.994625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:42.995921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:43.063347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 543/1052] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:43.075744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.085641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 510/1053] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:43.085928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.086647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.197162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff0e4-81a2-4e01-82d7-8d273126b34b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.199446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7deeaf-5c9d-4a0c-b43b-5abbc36ffbdc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.235206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.235616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.236125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.236404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.236675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.237015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.237462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.237882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.238010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] PATH_INFO: `/v3/services/image` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.238789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.239307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.240448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.241170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 511/1054] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:43.243690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.246956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:43.254027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:43.255022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 23:26:43.255883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:43.260418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 544/1055] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:43.261109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.320562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.358435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de56fd-6f06-43ae-ac18-a5251e829b8f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.364917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48875c0c-9b99-444c-af1a-88d68b8bd849 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.395435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.396091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.396370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.396657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.397487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=db4fcba990244564a70212d314167a21, user.id=f7cf574216c548f5b4091026e079d938) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:43.397802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.399224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.400956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.401657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.401941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.402222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.402931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] RBAC: Adding query filter params (name=image) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:43.403240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.404591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab4ba-90cd-404c-a6cc-57f00392c85e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.406855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 512/1056] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/role_assignments?user.id=f7cf574216c548f5b4091026e079d938&scope.project.id=db4fcba990244564a70212d314167a21&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:43.421616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 545/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:43.428347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.539466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a83900-8234-4ba6-ab7d-da1b8da33a98 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.546457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447b8b-40f2-4dcf-aee1-7086fd1bc578 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.547463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447b8b-40f2-4dcf-aee1-7086fd1bc578 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.547758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447b8b-40f2-4dcf-aee1-7086fd1bc578 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.549467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 546/1058] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:43.554829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.555125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.555409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.573567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.573750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:43.574901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:43.580102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.580775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.581060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.581415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.582123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:43.582427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.583792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.588832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 513/1059] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:43.595523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.641015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.651752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 547/1060] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:43.674867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.697128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212b32-33ad-4525-8a21-07ed9c2cbad2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.734122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.734789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.735068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.735373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.736074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:43.737461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:43.765215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 514/1061] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:26:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:26:43.790483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb58b6b-96a2-446e-96c3-54c2c040951c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:43.837466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:43.838395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:43.838729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:43.838982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:43.852466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:43.862040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:43.863056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:43.863954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 548/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:43.870986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:43.930809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:43.983646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c3af4-75b0-4555-9cde-dae703c6dd4d None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.018982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.019653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.019934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.020207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.020951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:44.021280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.022657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.036353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 515/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:44.037573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.088369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:44.149404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9070bac-1ee7-4008-bc8a-d4405a4148ff None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.185198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.186010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.186294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.186569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.198099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.199543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:44.217680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:44.219713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:44.221176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:44.221176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:44.221176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:44.221176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:44.224357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 549/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:44.225408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.329528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65eae0-b6ab-465a-9146-51656817ac87 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.342941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:44.364696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.365392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.365677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.365953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.366671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:44.366978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.368342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.380506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 516/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:44.386160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.487948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758a9bc-0adf-406c-8cf7-864114d40b6d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.489553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:44.525140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.525990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.526278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.526556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.535845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.537312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:44.551330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:44.552299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:44.553276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:44.558790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 550/1066] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:44.558926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.659905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516c61-1d82-4fc2-af9d-65e5d2475896 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.693083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.693768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.694051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.694324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.695138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:44.695438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.696849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.714022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 517/1067] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:44.719943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.822026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfa97e-aef3-43e5-92c9-7472626ce0b9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:44.854777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:44.855568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:44.855846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:44.856117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:44.867520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:44.868958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:44.889281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:44.890239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:44.891211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:44.891211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:44.891211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:44.891211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:44.891997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 551/1068] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:44.896139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:44.935818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.007322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad5c5a-361c-4c33-88e8-eb562793e6a3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.041533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.042200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.042485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.042761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.043480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:45.043790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:45.045153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:45.061462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 518/1069] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:45.063011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.080405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.170641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88eed7-1b08-44d6-8762-3bf6da3c67f9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.203704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.204419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.204694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.204962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.211678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:45.213110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:45.227763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:45.228704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:45.229639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:45.233502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 552/1070] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:45.234751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.329909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.339776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861e4b-2457-45ea-ba0e-08630d1b0cda None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.374026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.375291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.375579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.375857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.376640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:45.376950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:45.378410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d116e-caef-477d-b813-559922eb3bc8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:45.391095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 519/1071] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:45.396861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.446930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764bb7-8397-49b2-bccf-251cf4dd4cdb None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.447247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764bb7-8397-49b2-bccf-251cf4dd4cdb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.447523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764bb7-8397-49b2-bccf-251cf4dd4cdb None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.448889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 520/1072] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:45.454480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.454693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.454964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.473169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:45.474376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:45.479525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.507618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51102cd-1598-494e-a81d-646d6258ca16 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.545790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.546742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.547025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.547302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/9e7f3af2884d4e9ca5b7bef4587f624a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.549543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=7524c2f848694708b1828c655383361c, role_id=9e7f3af2884d4e9ca5b7bef4587f624a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:45.550973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:45.553483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 521/1073] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:45.567582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.568971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 553/1074] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:45 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7524c2f848694708b1828c655383361c/roles/9e7f3af2884d4e9ca5b7bef4587f624a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:26:45.664884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.685220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe70cdc-89c3-4a3d-adac-0b9abb971944 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.728238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.728963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.729272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.729562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.740459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-7651861d-c758-4a26-9e49-f3470a9334af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:45.748110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:45.749031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:45.750470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 522/1075] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:45.756618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.859935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f1241-ebc7-43b0-a879-424e9186d6e3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:45.877998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7101-8405-4d4e-b5a1-db27d47e3001 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.878295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7101-8405-4d4e-b5a1-db27d47e3001 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.878548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7101-8405-4d4e-b5a1-db27d47e3001 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.880055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 523/1076] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:45.884709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e941-5982-4fae-833a-439360f1d640 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.885269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e941-5982-4fae-833a-439360f1d640 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.885624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e941-5982-4fae-833a-439360f1d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.895651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:45.896330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:45.896611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:45.896886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:45.897666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:45.897968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:45.899345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:45.900780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:45.903562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e316e941-5982-4fae-833a-439360f1d640 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:45.904738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e316e941-5982-4fae-833a-439360f1d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:45.911691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 554/1077] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:45.917237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:45.983854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 524/1078] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:46.007651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e941-5982-4fae-833a-439360f1d640 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:46.021426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e3c84-9f5b-4a13-b730-30b421d432d3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.056491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.057395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.057680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.057963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] PATH_INFO: `/v3/users/f7cf574216c548f5b4091026e079d938` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.059167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] RBAC: Authorizing `identity:get_user(user_id=f7cf574216c548f5b4091026e079d938)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.060594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.062893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 555/1079] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:45 2022] GET /identity/v3/users/f7cf574216c548f5b4091026e079d938 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:46.068616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:46.086421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:46.122114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e941-5982-4fae-833a-439360f1d640 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.142551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:46.161913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.163589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.163589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.163589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.183976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196feb87-7432-45cf-9449-95e639d042fe None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.224913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.226102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.226387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.226662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.228287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.230015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.239303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 556/1080] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:26:46 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:46.239463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.239463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.240075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:46.310841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:46.345461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 525/1081] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:46.351598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:46.358884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869f108-86eb-465f-8aee-c5950b2678de None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.390565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:46.396244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.397147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.397734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.397876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21/users/f7cf574216c548f5b4091026e079d938/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.399819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4fcba990244564a70212d314167a21, user_id=f7cf574216c548f5b4091026e079d938, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.401291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.414739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 557/1082] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:46 2022] PUT /identity/v3/projects/db4fcba990244564a70212d314167a21/users/f7cf574216c548f5b4091026e079d938/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:26:46.461384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbebed-a311-4510-8560-b7c2a27da576 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.500379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.501217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.501498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.501772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.513247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.514735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f89b413d-362b-487e-a834-7ac55532d426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:46.534351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:46.535331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:46.541579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:46.541579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:46.541579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:46.541579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:46.541579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 526/1083] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:46.543442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:46.650684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9167b-10b5-4d9b-9f4e-8f6310ab0b59 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:46.686898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:46.687608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:46.687889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:46.688163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:46.688890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:46.689208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:46.690604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df390e-9ea0-47da-95ba-4145e6cfb497 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:46.709295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 558/1084] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:47.596855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889721c-e1e1-44fb-a834-ad24ba10db9a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:47.597409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889721c-e1e1-44fb-a834-ad24ba10db9a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:47.597501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889721c-e1e1-44fb-a834-ad24ba10db9a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:47.598816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 527/1085] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:47.604093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:47.604470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:47.604787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:47.621985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:47.623159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:47.670772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:47.692122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 559/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:47.714670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889721c-e1e1-44fb-a834-ad24ba10db9a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:47.740122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:47.822330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889721c-e1e1-44fb-a834-ad24ba10db9a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:47.855698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:47.856428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:47.856711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:47.856984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:47.867566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:47.875781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:47.876898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:47.877828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 528/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 23:26:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:26:47.882904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:47.978178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae6fa8-0d22-46dc-9097-aefeac0e87d8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.011569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.012238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.012517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.012787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.013561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:48.013865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.015355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.023313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 560/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:26:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:48.028902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.117959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.135260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb003d9-b487-4950-9fab-b949d59bcf90 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.170717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.171685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.172173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.172173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.182598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.184034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:48.200577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:48.201507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:48.202388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:48.202388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:48.202388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:48.202388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:48.202388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 529/1089] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:48.208077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.255486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.312122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24e817-0299-4266-beea-6f8a0cae4268 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.346584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.347243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.347527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.347800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.348510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:48.348814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.350204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c5d5b-e4a3-40b5-9c36-6dad0c45684c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.366611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 561/1090] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:48.367647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.466226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168d585-7361-4c60-9898-cb25b2728aa3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.469576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370b19c-8fc4-46be-8f59-d7a7d7442f6a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.469866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370b19c-8fc4-46be-8f59-d7a7d7442f6a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.470143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370b19c-8fc4-46be-8f59-d7a7d7442f6a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.471499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 562/1091] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:26:48.476417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.476700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.476976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.493474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:48.494657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:48.500367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.501157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.501462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.501736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.504427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.510281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.512098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:26:48.527100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:48.528092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:48.529046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 530/1092] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:48.534310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.561844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 563/1093] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:26:48.586143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.618519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.635877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf45994-ec88-431b-a3bf-eeee8002ccb6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.669643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.670395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.670685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.670960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.671790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:48.672097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.673545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.684626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccd1a2-4969-4ec7-a6bd-b2fc5f21d72c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.691933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 531/1094] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:48.697536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.719713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.720503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.720783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.721054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.731152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:26:48.738898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:48.739939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:26:48.740787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 564/1095] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:48.745940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.752515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.798659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d241-6a10-450f-aa71-33218df0609b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.833623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.834276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.834562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.834836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.842641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:48.850397 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48c53-92ed-4516-ad24-7330229dafec None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:48.883820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:48.884415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:48.884698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:48.885263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:48.886050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:48.886342 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.887710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.897108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 565/1096] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:48.901969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:48.902799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:48.903346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:48.956641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.000528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc678-a091-4eb6-b5b1-cbd9daba8fe1 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.002470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 532/1097] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:49.008101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.033931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.034800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.035077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.035352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] PATH_INFO: `/v3/users/f7cf574216c548f5b4091026e079d938` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.036545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] RBAC: Authorizing `identity:get_user(user_id=f7cf574216c548f5b4091026e079d938)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.037999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.044504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 566/1098] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:48 2022] GET /identity/v3/users/f7cf574216c548f5b4091026e079d938 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:49.045302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.069798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.112681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abef8d-b534-46c1-81a7-410c108a1868 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.148273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.148988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.149299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.149580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.154130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748596c-352c-4880-b3d3-8afe0c8704e6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.160096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.161554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:26:49.179246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:49.180170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:49.181332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:26:49.181332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:26:49.181332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:26:49.181332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:49.181332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 533/1099] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:49.185992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.190385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.191033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.191314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.191590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.194310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.258722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.260434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.284262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.285651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8776-de96-42d7-9863-2899ff84897a None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.320350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.321010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.321320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.321599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.322313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:49.322619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.323977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.336136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 534/1100] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:49.341705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.360261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 567/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:26:49.365982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.406512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.441727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366b4d-5262-4626-839a-600ba068f4a6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.463205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95bd1-2d80-4540-bec4-7a2f94b47146 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.474957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.475739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.476019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.476292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.482839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.484517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.487076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.498199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:26:49.499028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:26:49.500585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:26:49.501549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:26:49.502492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.502492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.502492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.502744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 535/1102] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:26:49.502825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.503139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.505019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 568/1103] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:49.506662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.510847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.607319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f097b-fc29-4abc-995c-468f443f95ab None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.610376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d08a90-4e5c-4e22-9b54-d556645139b2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.635992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.643078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.643721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.643998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.644270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.645086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=db4fcba990244564a70212d314167a21, user.id=f7cf574216c548f5b4091026e079d938) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:49.645417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.645660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.646344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.646631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.646837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.646928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.647689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:49.647999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.649426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa0051-d974-4784-a2e5-88ac3c494ceb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.652770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 569/1104] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/role_assignments?user.id=f7cf574216c548f5b4091026e079d938&scope.project.id=db4fcba990244564a70212d314167a21&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:26:49.662289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 536/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:49.668455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:49.729592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:49.777709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8519e1-45e4-4cd5-a870-7ef54451e4df None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:49.815160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:49.815824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:49.816107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:49.816389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:49.817255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] RBAC: Adding query filter params (role.id=9e7f3af2884d4e9ca5b7bef4587f624a, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7524c2f848694708b1828c655383361c) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:49.817570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:49.819001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e878-626f-4d18-8e0d-47ec41976788 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:49.825047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 570/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:49 2022] GET /identity/v3/role_assignments?user.id=7524c2f848694708b1828c655383361c&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=9e7f3af2884d4e9ca5b7bef4587f624a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:51.708653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4462d-1671-4ab7-aab2-081910a17eba None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:51.709249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4462d-1671-4ab7-aab2-081910a17eba None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:51.709249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4462d-1671-4ab7-aab2-081910a17eba None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:51.710611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 537/1107] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:51.715776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:51.716184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:51.716327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:51.732470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:51.733854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:51.799243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 571/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:51.823899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4462d-1671-4ab7-aab2-081910a17eba None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:51.923226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4462d-1671-4ab7-aab2-081910a17eba None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:51.955623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:51.956397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:51.956679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:51.956954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:51.958135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:51.959615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3ff32-a3b6-4302-9edf-9d8fb13d50e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:51.961154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 538/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:51.966748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:52.015957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:52.064059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d8a0d-ebb5-449a-a85b-24585ff73b7f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:52.096411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:52.097079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:52.097388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:52.097664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:52.098390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:52.099817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cda6f9-0035-446f-ae36-a039f702ce18 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:52.120003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 572/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:26:51 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:26:54.181357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8691ee-2d90-47c4-838c-cf21ad3dd406 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:54.181849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8691ee-2d90-47c4-838c-cf21ad3dd406 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:54.181849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8691ee-2d90-47c4-838c-cf21ad3dd406 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:54.183135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 539/1111] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:54.188378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:54.188846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:54.188938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:54.205853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:54.207041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:54.273925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 573/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:54.297177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8691ee-2d90-47c4-838c-cf21ad3dd406 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:54.353093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:54.399641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8691ee-2d90-47c4-838c-cf21ad3dd406 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:54.434356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:54.435201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:54.435517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:54.435789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] PATH_INFO: `/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:54.438252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] RBAC: Authorizing `identity:get_role(role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:54.439611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:54.440983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 540/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:54 2022] GET /identity/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:54.446786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:54.479972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:54.542880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440b62b-0323-4c44-859a-d8fcf962bdd6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:54.575713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:54.576575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:54.576861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:54.577135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] PATH_INFO: `/v3/users/931b2c3105104fc9852cd5e3e866221a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:54.590347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] RBAC: Authorizing `identity:get_user(user_id=931b2c3105104fc9852cd5e3e866221a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:54.591780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:54.593578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 574/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:54 2022] GET /identity/v3/users/931b2c3105104fc9852cd5e3e866221a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:54.599313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:54.695710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85178367-395d-4cc2-b1a9-29e87d22c9da None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:54.717659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:54.729451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:54.730086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:54.730367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:54.730641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:54.799367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:54.800811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:54.895967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 541/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:26:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:26:54.901867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:54.992295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:54.999844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34b159-f7e3-4fc4-995f-b2587c60a364 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:55.032979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:55.033850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:55.034132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:55.034406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:55.035565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:55.036988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71be6b-9029-4de6-b4c6-6bd4f0741580 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:55.038687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 575/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:26:54 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:55.044756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:55.069099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:55.145306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcb972-236b-4d45-beb1-e937a391c2f4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:55.178126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:55.178768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:55.179048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:55.179321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:55.180131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=db4fcba990244564a70212d314167a21, user.id=931b2c3105104fc9852cd5e3e866221a) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:26:55.180436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:55.181881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c31bd-2771-4032-9ded-d0b2d66619ab None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:55.187960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 542/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:26:55 2022] GET /identity/v3/role_assignments?user.id=931b2c3105104fc9852cd5e3e866221a&scope.project.id=db4fcba990244564a70212d314167a21&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:57.181106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35208-5695-4e8b-b152-a8df53e771d6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.181629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35208-5695-4e8b-b152-a8df53e771d6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.181731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb35208-5695-4e8b-b152-a8df53e771d6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.183051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 576/1118] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:57.188108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.188496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.188652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.205449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:57.206631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:57.270434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 543/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:57.292568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb35208-5695-4e8b-b152-a8df53e771d6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:57.391254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb35208-5695-4e8b-b152-a8df53e771d6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:57.425563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:57.426416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.426695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.426967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] PATH_INFO: `/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.428428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] RBAC: Authorizing `identity:get_role(role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:57.429821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:57.431182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 577/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:57 2022] GET /identity/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:57.436955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:57.453993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:57.538432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861505cf-20bd-45c8-b54d-d770e5b090b2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:57.571073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:57.571931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.572214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.572487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] PATH_INFO: `/v3/users/931b2c3105104fc9852cd5e3e866221a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.573675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] RBAC: Authorizing `identity:get_user(user_id=931b2c3105104fc9852cd5e3e866221a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:57.575094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:57.576703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 544/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:57 2022] GET /identity/v3/users/931b2c3105104fc9852cd5e3e866221a => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:57.582760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:57.613250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:57.680657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe4fb-b2db-4d4d-90b1-fcbb5d831666 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:57.712208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:57.713050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.713356 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.713628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.714776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:57.716184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfc105-ef2c-4e46-97da-2b4646f83f31 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:57.718458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 578/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:26:57 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:26:57.724594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:26:57.807229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:26:57.822936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5646e82-a7fb-4842-9446-97c609eef347 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:26:57.856277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:26:57.857152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:57.857465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:57.857743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21/users/931b2c3105104fc9852cd5e3e866221a/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:57.859970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] RBAC: Authorizing `identity:create_grant(project_id=db4fcba990244564a70212d314167a21, user_id=931b2c3105104fc9852cd5e3e866221a, role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:26:57.861425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc074dfb-7383-4c47-89e9-4488035bb685 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:26:57.873388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 545/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:26:57 2022] PUT /identity/v3/projects/db4fcba990244564a70212d314167a21/users/931b2c3105104fc9852cd5e3e866221a/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:26:59.879893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b47ee5-018c-4cde-a0e5-ab872ada777c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:59.880448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b47ee5-018c-4cde-a0e5-ab872ada777c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:59.880448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b47ee5-018c-4cde-a0e5-ab872ada777c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:59.881817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 579/1124] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:26:59.887248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:26:59.887663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:26:59.887792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:26:59.905048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:26:59.906759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:26:59.971370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 546/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:26:59.993733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b47ee5-018c-4cde-a0e5-ab872ada777c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:00.088310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:00.093739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b47ee5-018c-4cde-a0e5-ab872ada777c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:00.128464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:00.129376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:00.129656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:00.129973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] PATH_INFO: `/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:00.131388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] RBAC: Authorizing `identity:get_role(role_id=bfbef5c55f8c4439b6e721c24f1e6252)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:00.132755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:00.134167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 580/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:26:59 2022] GET /identity/v3/roles/bfbef5c55f8c4439b6e721c24f1e6252 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:00.140266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:00.211866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:00.237378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ec956-987f-4e37-be73-cf2836da0733 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:00.271000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:00.271966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:00.272309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:00.272581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] PATH_INFO: `/v3/users/931b2c3105104fc9852cd5e3e866221a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:00.273823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] RBAC: Authorizing `identity:get_user(user_id=931b2c3105104fc9852cd5e3e866221a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:00.275245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:00.276869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 547/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:00 2022] GET /identity/v3/users/931b2c3105104fc9852cd5e3e866221a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:00.283260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:00.379184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84202af-2d97-463f-99f5-f37eecc49579 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:00.412605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:00.413375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:00.413558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:00.413830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:00.445993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:00.479886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:00.481362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:00.575463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 581/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:00.581616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:00.679123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e9970-1eb1-4725-bfd9-482778932489 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:00.710835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:00.711675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:00.711957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:00.712229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] PATH_INFO: `/v3/projects/db4fcba990244564a70212d314167a21` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:00.713417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] RBAC: Authorizing `identity:get_project(project_id=db4fcba990244564a70212d314167a21)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:00.714828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81f2da-37b1-4ad9-92e2-c2022e473181 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:00.716492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 548/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:00 2022] GET /identity/v3/projects/db4fcba990244564a70212d314167a21 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:00.723079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:00.787877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:00.821777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55268-253d-44d1-b97a-265753c293ab None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:00.854891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:00.855533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:00.855815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:00.856087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:00.856904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] RBAC: Adding query filter params (role.id=bfbef5c55f8c4439b6e721c24f1e6252, scope.project.id=db4fcba990244564a70212d314167a21, user.id=931b2c3105104fc9852cd5e3e866221a) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:00.857269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:00.858870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69ff6c-4a46-4b66-b7b9-41790768956c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:00.864498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 582/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:27:00 2022] GET /identity/v3/role_assignments?user.id=931b2c3105104fc9852cd5e3e866221a&scope.project.id=db4fcba990244564a70212d314167a21&role.id=bfbef5c55f8c4439b6e721c24f1e6252 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:02.895924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63f73-4931-4f96-a6ed-a9139bf7b828 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:02.896470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63f73-4931-4f96-a6ed-a9139bf7b828 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:02.896470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63f73-4931-4f96-a6ed-a9139bf7b828 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:02.897848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 549/1131] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:02.902879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:02.903264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:02.903442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:02.920262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:02.922073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:02.986981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 583/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:03.009691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d63f73-4931-4f96-a6ed-a9139bf7b828 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:03.021726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:03.111064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d63f73-4931-4f96-a6ed-a9139bf7b828 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:03.144038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:03.144811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:03.145090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:03.145399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:03.146593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:03.147963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb8ad-a28f-4042-ba0f-20a3d5fef62c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:03.149585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 550/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:27:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:03.155984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:03.212025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:03.252407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf56d9d-7e5b-444f-b64a-606a6d1197ef None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:03.286452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:03.287103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:03.287385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:03.287657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:03.288374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:03.289859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d3ef8-fa8e-4714-a384-a00fc9c3d8fd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:03.315164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 584/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:27:03 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:27:05.354054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df665-fd41-4f27-b58f-577ba1889516 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:05.354607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df665-fd41-4f27-b58f-577ba1889516 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:05.354607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df665-fd41-4f27-b58f-577ba1889516 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:05.355965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 551/1135] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:05.362049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:05.362433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:05.362552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:05.379368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:05.380538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:05.446967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 585/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:05.472051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df665-fd41-4f27-b58f-577ba1889516 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:05.549431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:05.571026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df665-fd41-4f27-b58f-577ba1889516 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:05.604313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:05.605094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:05.605406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:05.605684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:05.606841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:05.608465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a582052-d0b8-4174-b48b-f0deb57ac0d1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:05.610117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 552/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:05.615804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:05.658007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:05.713860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c994a-454a-424e-8da2-f6e9d625527f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:05.746890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:05.747556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:05.747840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:05.748117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:05.749404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:05.750829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c90f2c-c961-4ea2-8e65-a753c57c45db None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:05.770997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 586/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:27:05 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:27:07.832004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a2c21-b5ac-4a2b-b99c-0b471bf37e05 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:07.832566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a2c21-b5ac-4a2b-b99c-0b471bf37e05 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:07.832566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a2c21-b5ac-4a2b-b99c-0b471bf37e05 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:07.833927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 553/1139] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:07.839198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:07.839596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:07.839759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:07.856542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:07.857772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:07.924068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 587/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:07.946931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a2c21-b5ac-4a2b-b99c-0b471bf37e05 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.047286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a2c21-b5ac-4a2b-b99c-0b471bf37e05 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.079714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.080477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.080758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.081028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.090845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:08.099405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:08.100612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:08.101765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 554/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:08.106668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.134787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:08.206668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f2286-1d53-4d3f-ae21-04f4134516ee None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.240050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.240695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.240976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.241274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.242011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:08.242318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:08.243668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:08.251807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 588/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:08.257595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.267125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:08.356650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29d2f7-9343-42fc-9ba9-1818c6eeed87 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.388638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.390016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.390297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.390567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] PATH_INFO: `/v3/users/4521a69dcc044a889b86cd06f73f4690` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.403267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] RBAC: Authorizing `identity:get_user(user_id=4521a69dcc044a889b86cd06f73f4690)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:08.404693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:08.406935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 555/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:08 2022] GET /identity/v3/users/4521a69dcc044a889b86cd06f73f4690 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:08.412734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.499919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:08.509716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defce65b-f8f7-4ca6-af85-3a0df4e72d65 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.542383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.543018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.543300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.543574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.608392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:08.609908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:08.693935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:08.704606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 589/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:08.710603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.771218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:08.807930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea9089-0cee-44ac-8340-d4511df1516f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.839965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.840802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.841078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.841376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] PATH_INFO: `/v3/projects/cf81aebe1ad74f9f86fb8067aea97813` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.843048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] RBAC: Authorizing `identity:get_project(project_id=cf81aebe1ad74f9f86fb8067aea97813)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:08.844449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de892a1a-940e-4b11-bb28-c020ff46d3ec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:08.846136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 556/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:08 2022] GET /identity/v3/projects/cf81aebe1ad74f9f86fb8067aea97813 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:08.852108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:08.947752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16d86-4235-4242-8952-9d2c4fcd4ab9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:08.980352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:08.980989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:08.981295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:08.981569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:08.982379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=cf81aebe1ad74f9f86fb8067aea97813, user.id=4521a69dcc044a889b86cd06f73f4690) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:08.982682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:08.984669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d43a37-7e37-45ea-bed1-548cf20f84db None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:08.990235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 590/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:27:08 2022] GET /identity/v3/role_assignments?user.id=4521a69dcc044a889b86cd06f73f4690&scope.project.id=cf81aebe1ad74f9f86fb8067aea97813&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:10.969343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c973-75ab-4dca-a11f-0c0dc39b31d5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:10.969901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c973-75ab-4dca-a11f-0c0dc39b31d5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:10.969901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02c973-75ab-4dca-a11f-0c0dc39b31d5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:10.971250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 557/1147] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:10.976457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:10.976864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:10.977014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:10.994117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:10.995287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:11.043494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:11.063817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 591/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:27:11.086107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c973-75ab-4dca-a11f-0c0dc39b31d5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:11.187059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02c973-75ab-4dca-a11f-0c0dc39b31d5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:11.215269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:11.220387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:11.221109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:11.221416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:11.221693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:11.231417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:11.239033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:11.240103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:11.240983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 558/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:11.246203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:11.342028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d3537-55f7-4a09-b7d8-95ed1fdf818c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:11.375563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:11.376211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:11.376486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:11.376755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:11.377705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:11.378010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:11.379359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:11.387419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 592/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:27:11.394146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:11.491905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8322d-ae3d-47af-b4ef-d94935543520 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:11.524969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:11.525841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:11.526122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:11.526395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] PATH_INFO: `/v3/users/4521a69dcc044a889b86cd06f73f4690` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:11.527547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] RBAC: Authorizing `identity:get_user(user_id=4521a69dcc044a889b86cd06f73f4690)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:11.528963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:11.531650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 559/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:11 2022] GET /identity/v3/users/4521a69dcc044a889b86cd06f73f4690 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:11.537361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:11.596477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:11.648174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72b1c-f6dd-4daa-98a4-ee585961b68d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:11.680489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:11.681361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:11.681641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:11.681910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] PATH_INFO: `/v3/projects/cf81aebe1ad74f9f86fb8067aea97813` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:11.683079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] RBAC: Authorizing `identity:get_project(project_id=cf81aebe1ad74f9f86fb8067aea97813)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:11.684503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f726f9-d96c-44ec-aadb-d2027823ea15 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:11.687042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 593/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:11 2022] GET /identity/v3/projects/cf81aebe1ad74f9f86fb8067aea97813 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:11.692967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:11.750717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:11.791009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9317-53d7-4841-9c49-66c924ef8936 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:11.824011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:11.824891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:11.825173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:11.825473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] PATH_INFO: `/v3/projects/cf81aebe1ad74f9f86fb8067aea97813/users/4521a69dcc044a889b86cd06f73f4690/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:11.827447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] RBAC: Authorizing `identity:create_grant(project_id=cf81aebe1ad74f9f86fb8067aea97813, user_id=4521a69dcc044a889b86cd06f73f4690, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:11.828865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f647-5550-450c-9d44-831e8b2d38ec None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:11.841178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 560/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:27:11 2022] PUT /identity/v3/projects/cf81aebe1ad74f9f86fb8067aea97813/users/4521a69dcc044a889b86cd06f73f4690/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:27:13.897259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6394d-57a4-47c9-91d5-ff777227832f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:13.897816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6394d-57a4-47c9-91d5-ff777227832f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:13.897816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6394d-57a4-47c9-91d5-ff777227832f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:13.899158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 594/1154] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:13.904220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:13.905096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:13.905369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:13.922409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:13.923593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:13.988235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 561/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:14.011220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6394d-57a4-47c9-91d5-ff777227832f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.110055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6394d-57a4-47c9-91d5-ff777227832f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:14.123686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:14.143807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:14.144597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:14.144884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:14.145162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:14.156242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:14.163717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:14.164817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:27:14.165907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 595/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:14.171568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.219151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:14.267379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15747c8-4278-415e-a51b-c430d2f158cf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:14.300768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:14.301448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:14.301735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:14.302011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:14.302746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:14.303050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:14.304401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:14.312478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 562/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:14.318129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.415063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab641b5e-f808-4862-b513-c543472121ec None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:14.448617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:14.449511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:14.449795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:14.450072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] PATH_INFO: `/v3/users/4521a69dcc044a889b86cd06f73f4690` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:14.451308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] RBAC: Authorizing `identity:get_user(user_id=4521a69dcc044a889b86cd06f73f4690)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:14.452877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:14.454547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 596/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/users/4521a69dcc044a889b86cd06f73f4690 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:14.460235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.558520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b0c9-650c-431d-ace7-911ac44d8937 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:14.571288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:14.591727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:14.592475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:14.592753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:14.593026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:14.657898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:14.659321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:14.754537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 563/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:14.760734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.803207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:14.858414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137a1a9-508e-4776-af5b-24f1514572e6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:14.892257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:14.893095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:14.893399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:14.893674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] PATH_INFO: `/v3/projects/cf81aebe1ad74f9f86fb8067aea97813` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:14.894832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] RBAC: Authorizing `identity:get_project(project_id=cf81aebe1ad74f9f86fb8067aea97813)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:14.896252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123955-874f-458e-9526-1b511ef18c25 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:14.897959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 597/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/projects/cf81aebe1ad74f9f86fb8067aea97813 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:14.904054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:14.917892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:15.000954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244fd58-9b5d-43d1-bb96-fe5a63d7f0c3 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:15.034256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:15.034841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:15.035129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:15.035406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:15.036221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=cf81aebe1ad74f9f86fb8067aea97813, user.id=4521a69dcc044a889b86cd06f73f4690) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:15.036528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:15.039461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a43f7-9f4f-4294-a02b-0010127d0440 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:15.044259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 564/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:27:14 2022] GET /identity/v3/role_assignments?user.id=4521a69dcc044a889b86cd06f73f4690&scope.project.id=cf81aebe1ad74f9f86fb8067aea97813&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:17.079556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebc86-6f3c-47a0-9125-c87a6caf498d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:17.080105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebc86-6f3c-47a0-9125-c87a6caf498d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:17.080105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ebc86-6f3c-47a0-9125-c87a6caf498d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:17.081503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 598/1162] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:17.086613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:17.087036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:17.087174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:17.104127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:17.105353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:17.171288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 565/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:27:17.193275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ebc86-6f3c-47a0-9125-c87a6caf498d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:17.292091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ebc86-6f3c-47a0-9125-c87a6caf498d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:17.302995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:17.325494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:17.326133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:17.326915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:17.327244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:17.392763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:17.394166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:17.490863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 599/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:17.496809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:17.505413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:17.594330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05115d98-f61b-4e87-a3e3-cd61b3e661fe None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:17.627711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:17.628501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:17.628786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:17.629063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:17.635891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:17.637355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-73fe1273-39a3-459a-847b-7f7a76da38cf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:17.651367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:17.652570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:17.653827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 566/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:27:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:17.659118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:17.671083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:17.757010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d0f-a158-4fd5-86b4-caecc5fb429c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:17.789739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:17.790391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:17.790671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:17.790941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:17.791654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:17.791955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:17.793336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af841bcd-4ff0-41f1-81cf-4aabe76189b3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:17.801095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 600/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 23:27:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:19.970581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08894bb-9abb-4d79-9790-7ca772a66be5 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:19.971134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08894bb-9abb-4d79-9790-7ca772a66be5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:19.971134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08894bb-9abb-4d79-9790-7ca772a66be5 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:19.972502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 567/1167] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:19.977711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9c22d-667f-48ce-b955-4f88a4bc0d3b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:19.978094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9c22d-667f-48ce-b955-4f88a4bc0d3b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:19.978265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9c22d-667f-48ce-b955-4f88a4bc0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:19.994605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f0d9c22d-667f-48ce-b955-4f88a4bc0d3b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:19.995793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f0d9c22d-667f-48ce-b955-4f88a4bc0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:20.062523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 601/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:20.086255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08894bb-9abb-4d79-9790-7ca772a66be5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:20.153693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:20.191129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08894bb-9abb-4d79-9790-7ca772a66be5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:20.224178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:20.224765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:20.225044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:20.225343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:20.226080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:20.227430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb6591-2388-4e69-8974-bfe63c78c196 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:20.241335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 568/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Thu Jul 21 23:27:20 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:27:22.285759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64795-2f79-4f37-bcd7-f14af2e5a441 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:22.286305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64795-2f79-4f37-bcd7-f14af2e5a441 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:22.286305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64795-2f79-4f37-bcd7-f14af2e5a441 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:22.287707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 602/1170] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:22.292839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:22.293236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:22.293427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:22.309800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:22.311755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:22.375445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 569/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:22.398831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64795-2f79-4f37-bcd7-f14af2e5a441 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:22.402610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:22.497398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64795-2f79-4f37-bcd7-f14af2e5a441 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:22.530969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:22.531819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:22.532100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:22.532375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] PATH_INFO: `/v3/domains/010687867bb44717b8360544157de1d4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:22.542407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=010687867bb44717b8360544157de1d4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:22.543842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394a4b5-4a77-43a0-b5ff-64779e7cf013 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:22.546069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 603/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Jul 21 23:27:22 2022] GET /identity/v3/domains/010687867bb44717b8360544157de1d4 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:22.551936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:22.605105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:22.649053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34f37-27f4-480d-85f7-685af12ec1ad None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:22.681610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:22.682254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:22.682532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:22.682800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:22.683483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:22.684890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfd807-79d7-46d7-9697-139f73dee4c4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:22.708864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 570/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:27:22 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:27:24.758732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124ec1-9718-4dec-a50d-16276f415c49 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:24.759508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124ec1-9718-4dec-a50d-16276f415c49 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:24.759508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124ec1-9718-4dec-a50d-16276f415c49 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:24.760890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 604/1174] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:24.767167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:24.767564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:24.767715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:24.784449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:24.785653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:24.850712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 571/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:24.876605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb124ec1-9718-4dec-a50d-16276f415c49 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:24.939895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:24.978122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb124ec1-9718-4dec-a50d-16276f415c49 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:25.011297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:25.012089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:25.012368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:25.012640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] PATH_INFO: `/v3/domains/010687867bb44717b8360544157de1d4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:25.014792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=010687867bb44717b8360544157de1d4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:25.016204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee349950-b644-46d2-afc4-00585c311adf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:25.017823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 605/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Jul 21 23:27:24 2022] GET /identity/v3/domains/010687867bb44717b8360544157de1d4 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:25.023522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:25.061942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:25.124145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef40f5-6443-4ac2-a9b9-a56390b32334 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:25.158212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:25.158873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:25.159156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:25.159428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:25.160135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:25.161590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3cf80-90be-4f11-84c1-6ed41d6b88be None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:25.180855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 572/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:27:25 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:27:27.224731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865260-3d91-4680-b2b4-ff64898362b8 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.225305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865260-3d91-4680-b2b4-ff64898362b8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.225305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef865260-3d91-4680-b2b4-ff64898362b8 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:27.226672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 606/1178] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:27.231868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.232423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.232621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:27.248859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:27.250065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:27.314683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 573/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:27.338103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865260-3d91-4680-b2b4-ff64898362b8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:27.439319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef865260-3d91-4680-b2b4-ff64898362b8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:27.469262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:27.474430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277be2-9018-4980-a612-718609785a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:27.475208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277be2-9018-4980-a612-718609785a3f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.475488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277be2-9018-4980-a612-718609785a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.475761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1277be2-9018-4980-a612-718609785a3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:27.486034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1277be2-9018-4980-a612-718609785a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f1277be2-9018-4980-a612-718609785a3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:27.493475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:27.494663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:27:27.495883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 607/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:27.501248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:27.525523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:27.598816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149feb6e-c6c0-4890-b1f3-f884343236b3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:27.632055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:27.632697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.632972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.633269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:27.634261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:27.634558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:27.635899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:27.644582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 574/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:27.650313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277be2-9018-4980-a612-718609785a3f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:27.746366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1277be2-9018-4980-a612-718609785a3f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:27.781106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:27.781976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.782255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.782526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] PATH_INFO: `/v3/users/44a2474d91594082a757450e00d1c0d0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:27.795934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] RBAC: Authorizing `identity:get_user(user_id=44a2474d91594082a757450e00d1c0d0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:27.797389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:27.799005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 608/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:27 2022] GET /identity/v3/users/44a2474d91594082a757450e00d1c0d0 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:27.804719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:27.894729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:27.909611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca050-cda1-48cd-9ce5-5bf64a3eae15 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:27.943218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:27.943855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:27.944133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:27.944405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:28.009817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:28.011179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:28.091459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:28.107504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 575/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:28.113884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:28.163663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:28.211895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a3158-8c75-42d0-ae45-fb99790dc595 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:28.245402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:28.246239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:28.246519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:28.246791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] PATH_INFO: `/v3/projects/a6216b28bcb647a7b38ede9337d69185` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:28.248446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] RBAC: Authorizing `identity:get_project(project_id=a6216b28bcb647a7b38ede9337d69185)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:28.249886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c2f10-59b3-4bab-8397-0aff348421de None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:28.251550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 609/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:28 2022] GET /identity/v3/projects/a6216b28bcb647a7b38ede9337d69185 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:28.257635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:28.352937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087fedc-fb54-45ab-9c9e-432301bcc2a1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:28.386135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:28.386778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:28.387061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:28.387341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:28.388159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=a6216b28bcb647a7b38ede9337d69185, user.id=44a2474d91594082a757450e00d1c0d0) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:28.388517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:28.390161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf40dd-7b54-432e-8fa0-a0a5ce93c849 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:28.395879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 576/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:27:28 2022] GET /identity/v3/role_assignments?user.id=44a2474d91594082a757450e00d1c0d0&scope.project.id=a6216b28bcb647a7b38ede9337d69185&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:30.403178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e121-4b8e-4e79-8e67-ae819dc9574f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:30.403689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e121-4b8e-4e79-8e67-ae819dc9574f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:30.403689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e121-4b8e-4e79-8e67-ae819dc9574f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:30.405751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 610/1186] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:30.410848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:30.411257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:30.411447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:30.428448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:30.429663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:30.473975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:30.494825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 577/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:30.517240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e121-4b8e-4e79-8e67-ae819dc9574f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:30.616438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e121-4b8e-4e79-8e67-ae819dc9574f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:30.632970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:30.649574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:30.650360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:30.650646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:30.650920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:30.661378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:30.668916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:30.670605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:27:30.671540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 611/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:30.676722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:30.771937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15f448-4c95-415f-bcf7-8ad57b5e2caa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:30.806166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880443-6089-455b-9789-c350df186601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:30.806829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880443-6089-455b-9789-c350df186601 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:30.807106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880443-6089-455b-9789-c350df186601 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:30.807375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880443-6089-455b-9789-c350df186601 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:30.808103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880443-6089-455b-9789-c350df186601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:30.808401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880443-6089-455b-9789-c350df186601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:30.809781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59880443-6089-455b-9789-c350df186601 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:30.817877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 578/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:30.823877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:30.921674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5400d-73ca-4e15-8702-2dc518be3460 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:30.953875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:30.954732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:30.955015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:30.955290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] PATH_INFO: `/v3/users/44a2474d91594082a757450e00d1c0d0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:30.956465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] RBAC: Authorizing `identity:get_user(user_id=44a2474d91594082a757450e00d1c0d0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:30.957920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:30.959541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 612/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:30 2022] GET /identity/v3/users/44a2474d91594082a757450e00d1c0d0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:30.965395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880443-6089-455b-9789-c350df186601 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:31.008951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:31.069858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880443-6089-455b-9789-c350df186601 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:31.104301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:31.105156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:31.105469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:31.105745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] PATH_INFO: `/v3/projects/a6216b28bcb647a7b38ede9337d69185` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:31.106975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] RBAC: Authorizing `identity:get_project(project_id=a6216b28bcb647a7b38ede9337d69185)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:31.108413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a306ab-a427-4a79-964c-d488df9f990e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:31.110163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 579/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:30 2022] GET /identity/v3/projects/a6216b28bcb647a7b38ede9337d69185 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:31.116099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:31.162184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:31.215933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ed8d7-a418-49aa-b300-6349f6e7e017 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:31.248134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:31.249006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:31.249320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:31.249598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] PATH_INFO: `/v3/projects/a6216b28bcb647a7b38ede9337d69185/users/44a2474d91594082a757450e00d1c0d0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:31.251538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6216b28bcb647a7b38ede9337d69185, user_id=44a2474d91594082a757450e00d1c0d0, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:31.252954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb290dde-d370-4194-b239-25157f74d367 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:31.265989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 613/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:27:31 2022] PUT /identity/v3/projects/a6216b28bcb647a7b38ede9337d69185/users/44a2474d91594082a757450e00d1c0d0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:27:33.273319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d12a-a839-4c00-a274-40ae0d0aae56 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.273861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d12a-a839-4c00-a274-40ae0d0aae56 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.273861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9d12a-a839-4c00-a274-40ae0d0aae56 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:33.275219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 580/1193] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:27:33.280964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.281419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.281565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:33.298873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:27:33.300088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:27:33.363916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 614/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:27:33.388158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9d12a-a839-4c00-a274-40ae0d0aae56 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:33.486651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9d12a-a839-4c00-a274-40ae0d0aae56 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:33.496412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:33.520791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:33.521596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.521872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.522153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:33.532365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:27:33.539839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:27:33.540912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:27:33.542135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 581/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:27:33.546968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:33.580615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:33.644079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0966f-f7f1-45d7-9e5e-5f9ef0a44ea4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:33.675901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:33.676553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.676838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.677110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:33.677878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:33.678178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:33.679535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:33.687891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 615/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:33.693613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:33.790870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db35b0-fea8-4205-b2cd-cac3e378cde5 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:33.824346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:33.825230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.825543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.825818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] PATH_INFO: `/v3/users/44a2474d91594082a757450e00d1c0d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:33.827008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] RBAC: Authorizing `identity:get_user(user_id=44a2474d91594082a757450e00d1c0d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:33.828433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:33.830091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 582/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 23:27:33 2022] GET /identity/v3/users/44a2474d91594082a757450e00d1c0d0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:33.835950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:33.929013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:33.932972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116409-9de8-43f4-824e-b5a238ca3999 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:33.965645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:33.966467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:33.966853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:33.967128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:34.032238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:34.033740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:34.125819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:34.130858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 616/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:27:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:27:34.136765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:34.177052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:34.236412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f691a6-0c1e-4b57-8590-abc991a1e026 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:34.269116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:34.269977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:34.270258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:34.270525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] PATH_INFO: `/v3/projects/a6216b28bcb647a7b38ede9337d69185` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:34.271670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] RBAC: Authorizing `identity:get_project(project_id=a6216b28bcb647a7b38ede9337d69185)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:34.273080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93699ea-6f85-4039-beed-f149f6d30f11 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:34.274772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 583/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 23:27:34 2022] GET /identity/v3/projects/a6216b28bcb647a7b38ede9337d69185 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:34.281657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:27:34.377155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389120-3bdc-468b-b380-daa2f01d90ac None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:27:34.410555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:27:34.411191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:27:34.411474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:27:34.411750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:27:34.412568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=a6216b28bcb647a7b38ede9337d69185, user.id=44a2474d91594082a757450e00d1c0d0) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:27:34.412878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:27:34.414331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c873f4-2749-4819-ad93-f02fa13df7d5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:27:34.420337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 617/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:27:34 2022] GET /identity/v3/role_assignments?user.id=44a2474d91594082a757450e00d1c0d0&scope.project.id=a6216b28bcb647a7b38ede9337d69185&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:27:44.265112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=47 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:27:44.417533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=69 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:30.093591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a46f9-ed0c-45d5-bff8-dd4f78abad56 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:30.094155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a46f9-ed0c-45d5-bff8-dd4f78abad56 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:30.094155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a46f9-ed0c-45d5-bff8-dd4f78abad56 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:30.096204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 584/1201] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:30.102915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:30.103418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:30.103418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:30.125840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:30.127395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:30.212001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 618/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:30.237292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a46f9-ed0c-45d5-bff8-dd4f78abad56 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:30.368529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a46f9-ed0c-45d5-bff8-dd4f78abad56 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:30.418610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:30.419408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:30.419690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:30.419963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:30.433353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:30.434979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:30.457717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:30.458771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:30.459762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:30.459762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:30.459762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:30.459762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:30.459762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 585/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:30.466211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:30.605381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ec527-3455-4e13-a75f-1ea77b014b3a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:30.649976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:30.659175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364403-cada-4386-b977-67ec643649d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:30.660425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364403-cada-4386-b977-67ec643649d5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:30.660813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364403-cada-4386-b977-67ec643649d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:30.661307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364403-cada-4386-b977-67ec643649d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:30.662155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364403-cada-4386-b977-67ec643649d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:30.662436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364403-cada-4386-b977-67ec643649d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:30.664154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63364403-cada-4386-b977-67ec643649d5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:30.679597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 619/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:30.685410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:30.752004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:30.809230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24968a6-8a53-486e-a56d-e53dcc578e67 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:30.855944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:30.857028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:30.857347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:30.857632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:30.858479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:30.860242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34e41-d4fa-4895-81f8-70ff9c72bf0b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:30.887925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 586/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 23:28:30 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:28:33.240253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcb4c-8493-494f-8e03-cc0594cd1680 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:33.240848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcb4c-8493-494f-8e03-cc0594cd1680 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:33.240848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bcb4c-8493-494f-8e03-cc0594cd1680 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:33.242276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 620/1206] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:33.247899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:33.248348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:33.248538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:33.267219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:33.268607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:33.348290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 587/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:33.371603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcb4c-8493-494f-8e03-cc0594cd1680 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:33.488627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bcb4c-8493-494f-8e03-cc0594cd1680 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:33.533025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:33.534017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:33.534296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:33.534614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:33.548809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:33.561950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:33.563010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:33.566153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 621/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:33.569229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:33.613714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:33.691825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032df4a-6b6b-4f90-92bb-fdb2707376ad None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:33.732019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:33.733233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:33.733689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:33.734118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:33.735257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:33.735727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:33.737632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:33.747660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 588/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:33.753205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:33.815765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:33.883308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c85dd7-f4f3-4259-8c80-b08d48f6c34b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:33.929791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:33.930600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:33.930881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:33.931156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:33.944751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:33.946534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:33.967344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:33.969334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:33.970260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:33.970260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:33.970260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:33.970260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:33.970260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 622/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:33.974883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:34.096411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:34.100837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66be0c-5181-4394-8290-9d8d173aeb3e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:34.143399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:34.144116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:34.144453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:34.144739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:34.145615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:34.145890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:34.147263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:34.160108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 589/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:34.166892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:34.279239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c919-dbc6-429c-b321-1dc54dd317bf None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:34.280898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:34.318670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:34.319818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:34.320170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:34.320511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:34.328846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:34.330610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:34.348268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:34.349758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:34.350877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 623/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:34.356678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:34.469447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e63cc3-30d7-4de8-a535-5568346dbdbe None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:34.508362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:34.509032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:34.509350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:34.509626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:34.510783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:34.511168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:34.512747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:34.536340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 590/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:34.541002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:34.662388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb53-f2a4-49d3-8d5a-5cc99d3bce5b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:34.700453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:34.701140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:34.701485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:34.701774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:34.741457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:34.787775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:34.789119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:34.910654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 624/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:28:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:28:34.916880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:34.938810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:35.031307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e022-4139-465b-85e1-905a8222a31e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:35.073168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724badf2-306b-4855-9623-69706c95422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:35.074065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724badf2-306b-4855-9623-69706c95422e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:35.074347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724badf2-306b-4855-9623-69706c95422e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:35.074602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724badf2-306b-4855-9623-69706c95422e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:35.086291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724badf2-306b-4855-9623-69706c95422e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:35.087756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724badf2-306b-4855-9623-69706c95422e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-724badf2-306b-4855-9623-69706c95422e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:35.113415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:35.120166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:35.121620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:35.121620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:35.121620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:35.121620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:35.121620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 591/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:35.121921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:35.194087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:35.242985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215e43-af2f-4a4f-9a04-248a195af894 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:35.285818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:35.286605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:35.286884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:35.287208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:35.288026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:35.288452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:35.289984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:35.304537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 625/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:35.312055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724badf2-306b-4855-9623-69706c95422e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:35.398154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:35.433447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724badf2-306b-4855-9623-69706c95422e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:35.474271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:35.475260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:35.475641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:35.476014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:35.484715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:35.486478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:35.502038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:35.503018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:35.503935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:35.508820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 592/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:35.510865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:35.627688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99bcaf-5f09-4d3d-9b0d-6728f2390c8f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:35.655087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:35.668087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:35.668834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:35.669179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:35.669543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:35.670422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:35.670791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:35.672269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be99822-cb92-4be8-a3c3-163d1b112bfc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:35.693286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 626/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:35.693889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:35.808341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b125a-c436-489e-88f3-dba7f8c04dd8 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:35.839435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:35.846590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:35.847400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:35.847807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:35.848173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:35.849168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7a1a855f0a324f6b8a76bdbe18a04911) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:35.849623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:35.851265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb77-a327-46ad-acf7-ab9fbf0415a4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:35.858319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 593/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:28:35 2022] GET /identity/v3/role_assignments?user.id=7a1a855f0a324f6b8a76bdbe18a04911&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:37.959631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fcae0-a4c4-46e8-ad5f-97901b0ccdc8 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:37.960345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fcae0-a4c4-46e8-ad5f-97901b0ccdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:37.960345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fcae0-a4c4-46e8-ad5f-97901b0ccdc8 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:37.962254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 627/1220] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:28:37.968493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:37.968954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:37.969222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:37.989497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:37.991102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:38.071379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 594/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 23:28:38.101626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fcae0-a4c4-46e8-ad5f-97901b0ccdc8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:38.220906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fcae0-a4c4-46e8-ad5f-97901b0ccdc8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:38.259332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:38.260939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:38.261241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:38.261516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:38.273780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:38.283264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:38.284241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:38.290471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 628/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:28:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:38.292120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:38.407337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf933-3bcb-4767-b9e6-1f35fd7e9f1a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:38.432971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:38.445671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:38.446482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:38.446764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:38.447044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:38.448182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] RBAC: Adding query filter params (name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:38.448679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:38.450637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:38.461034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 595/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:28:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:38.467382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:38.515088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:38.576255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26602b-b4b7-468f-aac6-2e5357da29c6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:38.611357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:38.612164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:38.612474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:38.612755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:38.625516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:38.627143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:38.646775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:38.647717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:38.649254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:38.649254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:38.649254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:38.649254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:38.649254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 629/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:38.655050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:38.760538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80178a8-a136-40fa-93c5-044d78f9369e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:38.798367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:38.799031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:38.799317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:38.799597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:38.800540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:38.800853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:38.802395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:38.815970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 596/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:38.821853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:38.924914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:38.932279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311615-8649-4061-97fb-a3f828bd7b86 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:38.967916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:38.968804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:38.969134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:38.969447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:38.977596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:38.979658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:38.995695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:38.996891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:38.997884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 630/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:39.003074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:39.057966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:39.122358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6348-1575-4c1f-b102-4a66b6b4008b None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:39.162534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:39.163314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:39.163659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:39.163994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:39.164907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:39.165372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:39.167420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:39.187545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 597/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:39.193703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:39.309129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5bfb6-67c3-48f4-bd17-0a94ea5471bb None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:39.348341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:39.349541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:39.350164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:39.350494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:39.365423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:39.367189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:39.386859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:39.388156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:39.389907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:39.389907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:39.389907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:39.389907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:39.389907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 631/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:39.393954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:39.512205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b881f-1114-4b48-9e93-17227c593bdc None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:39.514584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:39.549511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:39.550725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:39.551211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:39.551682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:39.553000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:39.553554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:39.556038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:39.573507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 598/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:39.580589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:39.592440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:39.706454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba3c32-0b82-4a66-b013-456da967b53b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:39.741657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:39.742483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:39.742736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:39.743009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:39.750449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:39.751976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:39.769110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:39.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:39.771437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 632/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:28:39.777144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:39.888510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e97b2-c64b-4ff2-94e8-71be35691b4f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:39.925774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:39.926497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:39.926763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:39.927076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:39.927968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:39.928300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:39.929770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbb20-d9db-414e-bfa3-e85d7eb0d556 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:39.942759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 599/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:39.949894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:40.021640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:40.059058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd1a6c-b9f4-447b-9e1a-fbe4604c4b0f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:40.096065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:40.096973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:40.097299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:40.097614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7a1a855f0a324f6b8a76bdbe18a04911/roles/4f8b6e0d7bb74b2b90321ff70daf0c18` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:40.114947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=7a1a855f0a324f6b8a76bdbe18a04911, role_id=4f8b6e0d7bb74b2b90321ff70daf0c18)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:40.116414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9f14-d94c-4cd9-afc8-f92559784ff0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:40.130551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 633/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:28:39 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7a1a855f0a324f6b8a76bdbe18a04911/roles/4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:28:42.368522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f392f-390b-4e8e-9f23-bcfdb2ff093f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:42.369644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f392f-390b-4e8e-9f23-bcfdb2ff093f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:42.369759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f392f-390b-4e8e-9f23-bcfdb2ff093f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:42.371115 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 600/1233] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:42.376463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:42.376853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:42.377024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:42.393545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:42.394746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:42.464002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 634/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:42.488332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f392f-390b-4e8e-9f23-bcfdb2ff093f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:42.514469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:42.607989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f392f-390b-4e8e-9f23-bcfdb2ff093f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:42.644563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:42.645306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:42.645588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:42.645859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:42.660389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:42.669731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:42.671070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:42.672150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 601/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 23:28:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:42.677445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:42.727381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:42.794139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e4559-0b9e-46db-b1fe-d30ad0f604af None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:42.833990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:42.834813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:42.835101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:42.835409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:42.836328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:42.836642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:42.838853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:42.848864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 635/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 23:28:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:42.855410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:42.950035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:42.968814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601ee9-e95e-4bcd-a9cb-8370cd42fda2 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:43.009156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:43.010471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:43.010773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:43.011063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:43.022176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:43.023640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:43.042542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:43.043789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:43.044874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:43.044874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:43.044874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:43.044874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:43.044874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 602/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:43.049875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:43.162854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7d111-5f9f-4da8-9853-2a69d0821f83 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:43.174258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:43.202980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:43.203478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:43.203778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:43.204048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:43.204774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:43.205081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:43.206495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:43.219596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 636/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:43.225329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:43.337063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc6c5-0b0e-4c6b-99fe-9b3e730787f1 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:43.380671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:43.381774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:43.382046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:43.382318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:43.385704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:43.391798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:43.393896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:43.410698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:43.411878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:43.412962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 603/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:43.418956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:43.531471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b706-a44a-4737-a763-945a1e08ae7b None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:43.571572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:43.572886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:43.573302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:43.573677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:43.575019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:43.575456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:43.576944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:43.596966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 637/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:43.604582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:43.722444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1fa6-596c-44b9-95c7-daac96336ff0 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:43.762361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:43.763335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:43.763608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:43.763876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:43.832711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:43.842075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:43.843833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:43.954636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 604/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:28:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 23:28:43.961620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:43.992968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:44.076761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd52c6-cc10-4d1f-93ce-58319d4c71c6 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:44.122666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:44.123467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:44.123759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:44.124020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:44.136369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:44.137871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:44.157290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:44.158232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:44.159132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:44.159132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:44.159132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:44.159132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:44.159132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 638/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:28:44.164498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:44.276681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:44.284050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c4042-cce6-426d-85df-1bb4e8f6cb93 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:44.327901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:44.328633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:44.328973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:44.329304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:44.330133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:44.330453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:44.332122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:44.345153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 605/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:44.350901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:44.437150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:44.459689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc694c-e7fc-479c-880f-19258d49c2cd None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:44.498986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:44.499795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:44.500148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:44.500413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:44.508350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:44.510092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:44.524827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:44.526106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:44.527141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 639/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:44.532459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:44.637299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544213c-daa8-4869-a23c-34e4c11faf0c None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:44.677079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:44.677819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:44.678149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:44.678481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:44.679438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:44.679750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:44.681216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038de612-d76e-4df9-8e46-8731a1c4abff None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:44.696159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 606/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:28:44.702253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:44.825497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb684a-6380-4667-b905-ccc29c7dee1e None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:44.878600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:44.879468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:44.879752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:44.880027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:44.881040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] RBAC: Adding query filter params (role.id=4f8b6e0d7bb74b2b90321ff70daf0c18, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7a1a855f0a324f6b8a76bdbe18a04911) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:44.881656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:44.883420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5252173-a485-41ad-8ee4-19f2bcc2aafb None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:44.892353 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 640/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:28:44 2022] GET /identity/v3/role_assignments?user.id=7a1a855f0a324f6b8a76bdbe18a04911&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=4f8b6e0d7bb74b2b90321ff70daf0c18 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:47.107084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284758a-e60e-4f3d-8399-83f9eb572e29 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.107643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284758a-e60e-4f3d-8399-83f9eb572e29 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.107643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284758a-e60e-4f3d-8399-83f9eb572e29 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.108989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 607/1247] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:28:47.114786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.115314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.115491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.122060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:47.137290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:47.138619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:47.211256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 641/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:47.235838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284758a-e60e-4f3d-8399-83f9eb572e29 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:47.256609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:47.351995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284758a-e60e-4f3d-8399-83f9eb572e29 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:47.393629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:47.394347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.394627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.394906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.406272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:47.415150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:47.417432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:47.418463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 608/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:47.423049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:47.535715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8a282-d976-49e2-82cb-2647765f48ad None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:47.568918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:47.575875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:47.576573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.576877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.577243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.578080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:47.578359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:47.579934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:47.589726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 642/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:47.596104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:47.687379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:47.714829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a099d2b-3dcd-4c14-bdfa-563e98e88362 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:47.754541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:47.755338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.755624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.755908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.768677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:47.770315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:47.794941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:47.796726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:47.797878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:47.797878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:47.797878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:47.797878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:47.797878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 609/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:47.802390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:47.930903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46410d8c-05ce-47e9-8310-2b522974d12d None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:47.970537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:47.971120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:47.971476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:47.971809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:47.972627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:47.972936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:47.974599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:47.988164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 643/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:47.995022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:48.120690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263a56-97b6-4e23-a25d-0fa5fd8754d4 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:48.162930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:48.172886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:48.173806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:48.174089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:48.174370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:48.183195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:48.184800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:48.201936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:48.203028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:48.203996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 610/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 23:28:48.210107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:48.273247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:48.323226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330c26-a2ee-4dc9-8a7f-0fea6c8c5f99 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:48.360679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:48.361384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:48.361735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:48.361960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:48.362874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:48.363184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:48.364728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:48.389162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 644/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:48.394953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:48.511548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aac6c-be8e-4399-acdc-8cd61c590afe None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:48.547613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:48.548437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:48.548851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:48.549158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:48.611261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:48.625586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:48.627229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:48.731388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 611/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:28:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:28:48.737315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:48.849133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1d476-b6d1-4088-8b8f-31db022509c5 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:48.863767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:48.890887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:48.891889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:48.892068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:48.892290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:48.902906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:48.904368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:48.924641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:48.925844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:48.927836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:48.927836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:48.927836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:48.927836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:48.927836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 645/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:48.933088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:49.030351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:49.045406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168b699-dee6-4ea3-9392-2820074a7cc9 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:49.083164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:49.083900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:49.084230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:49.084538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:49.085369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:49.085673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:49.087166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:49.105483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 612/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:49.107154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:49.222271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108bbb-1e9b-46f3-b1fe-31d9b3b47203 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:49.258529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:49.259936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:49.260222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:49.260583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:49.267323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:49.268807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:49.282882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:49.284373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:49.285797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 646/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:49.290734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:49.405718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ab057-2f47-4f74-bfd1-ee1bd1db434e None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:49.442737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:49.443394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:49.443672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:49.443942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:49.444828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:49.445171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:49.447937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef44788-dde4-486b-8955-1e767c35bbf9 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:49.460690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 613/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:49.467859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:49.496007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:49.581227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd8499-593b-4103-adab-6eed0fb28ac0 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:49.617545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:49.618222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:49.618501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:49.619360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:49.620277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7a1a855f0a324f6b8a76bdbe18a04911) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:49.620590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:49.622113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ce90d-cd66-45e2-bf94-f2ec3133f3cd None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:49.628422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 647/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:28:49 2022] GET /identity/v3/role_assignments?user.id=7a1a855f0a324f6b8a76bdbe18a04911&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:51.664980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32308-24fa-4689-83af-09036f544178 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:51.665589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32308-24fa-4689-83af-09036f544178 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:51.665589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f32308-24fa-4689-83af-09036f544178 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:51.666969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 614/1261] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:51.671955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:51.672351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:51.672513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:51.689332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:51.690509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:51.755576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 648/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:51.779063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32308-24fa-4689-83af-09036f544178 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:51.791600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:51.889842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f32308-24fa-4689-83af-09036f544178 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:51.922672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:51.923388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:51.923671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:51.923946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:51.934298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:51.941853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:51.942932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:51.943947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 615/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:51.949239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:51.967014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:52.045889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9cf68-7bd4-4fe8-9a0a-e709ea304c10 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.080025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.080726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.081012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.081321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.082071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:52.082379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.083745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.092626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 649/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:52.098517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:52.172078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:52.205760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9afa8-4ffb-4936-87f7-85e5e431973f None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.237535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.238320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.238603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.238875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.249695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.251137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:52.268502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:52.269533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:52.270777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:52.270777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:52.270777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:52.270777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:52.270777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 616/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:52.275765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:52.354523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:52.373588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284077-beb0-432f-8d78-45a571e4f6cc None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.406280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.406924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.407206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.407479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.408189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:52.408492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.409867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.421385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 650/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:52.427136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:52.523604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390edb4-94b0-4466-95c1-a83155064667 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.543989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:52.558160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.558945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.559223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.559493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.566719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.568129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:52.582660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:52.583774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:52.584931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 617/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:52.590478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:52.687453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679b78b-dd43-49cf-9f17-5c796bd68a21 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.721157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.721835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.722113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.722382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.723206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:52.723509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.724916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.733640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:52.742154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 651/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:52.747837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:52.858163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242b5c7-7194-44b8-af5f-d8f9782310eb None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:52.891201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:52.891981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:52.892259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:52.892530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:52.903672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:52.905097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:52.921985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:52.923086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:52.924339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:52.924339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:52.924339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:52.924339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:52.924339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 618/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:52.928828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:53.026895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637de4f-e198-4ea0-afe4-666b1d064b97 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:53.060601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:53.061281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:53.061565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:53.061841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:53.062556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:53.062862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:53.064223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:53.075729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 652/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:53.081234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:53.112055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:53.179930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8203f2d-5605-4d93-9d77-8466eb2c6077 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:53.213167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:53.213984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:53.214266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:53.214541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:53.221022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:53.222497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:53.236238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:53.237329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:53.238342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 619/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:53.243882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:53.302336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:53.344027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc0e93-49b9-42af-b409-e1a0bc11b6ae None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:53.377196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:53.377811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:53.378093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:53.378369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:53.379151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:53.379459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:53.381144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cace490-6ee5-4c0f-924a-d1f011e20dbc None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:53.394263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 653/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:53.401038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:53.490821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:53.499932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670fe01-1823-4f1c-867f-4dca7482c394 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:53.533706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:53.534575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:53.534860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:53.535138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] PATH_INFO: `/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7a1a855f0a324f6b8a76bdbe18a04911/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:53.537071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=10357e8222ea424cab4e5c62a7b0087b, user_id=7a1a855f0a324f6b8a76bdbe18a04911, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:53.538531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbd717-2197-40eb-9675-e2a868a21ee2 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:53.550558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 620/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 23:28:53 2022] PUT /identity/v3/projects/10357e8222ea424cab4e5c62a7b0087b/users/7a1a855f0a324f6b8a76bdbe18a04911/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:28:55.560568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b04e-b002-4d18-b893-cf4e047094dd None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:55.561091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b04e-b002-4d18-b893-cf4e047094dd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:55.561091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b04e-b002-4d18-b893-cf4e047094dd None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:55.562499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 654/1274] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:55.567521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:55.567891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:55.568076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:55.584340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:55.585548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:55.649553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 621/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:55.672783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b04e-b002-4d18-b893-cf4e047094dd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:55.771730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b04e-b002-4d18-b893-cf4e047094dd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:55.789767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:55.810776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:55.811627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:55.811967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:55.812326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:55.823634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 23:28:55.831334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:55.832461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:55.833536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 655/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 23:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:55.839545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:55.920193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:55.938753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d73d85-1435-4dfd-bed5-684c1032f862 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:55.971436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:55.972089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:55.972372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:55.972648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:55.973413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:55.973719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:55.975107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:55.983492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 622/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 23:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:55.989347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:56.086336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b0d49-bcdc-47f4-93ad-01c103fff52c None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:56.119792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:56.120576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:56.120854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:56.121121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:56.131585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:56.133011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:56.151012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:56.152059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:56.153102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:56.153102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:56.153102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:56.153102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:56.153102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 656/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:56.158033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:56.258412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d88e2-ad77-4a9f-a585-bdc9fc25f331 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:56.291945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:56.292607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:56.292890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:56.293168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:56.293911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:56.294216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:56.295579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:56.307055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 623/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:56.312689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:56.343852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:56.410937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bd3e-5140-4709-9fe7-f7e359a9b66f None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:56.443042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:56.443827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:56.444107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:56.444383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:56.452083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:56.453533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 23:28:56.468066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:56.469216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:28:56.470380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 657/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:56.475005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:56.478870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:56.570307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510c29d-bb39-45ba-a278-4a754e37a620 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:56.603262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:56.603855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:56.604131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:56.604399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:56.605233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:56.605541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:56.606941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:56.623245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 624/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 23:28:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:56.628867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:56.719215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:56.729021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fb2e4-6f67-42e6-82d8-f96d5fbb96a9 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:56.762601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:56.763244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:56.763528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:56.763805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:56.836443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:56.838539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:56.924541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:56.934977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 658/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 23:28:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 23:28:56.940722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:57.001344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:57.038990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0d36d-81f7-499e-a04e-43a85d0cb063 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:57.072530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:57.073325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:57.073610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:57.073879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:57.083586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:57.085017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 23:28:57.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:57.103976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:57.104893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 23:28:57.104893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 23:28:57.104893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 23:28:57.104893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:57.104893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 625/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:57.109715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:57.205378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673709a1-51ee-469d-9bcc-e3a5a2067fc3 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:57.238418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:57.239066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:57.239347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:57.239622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:57.240326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:57.240628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:57.242010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:57.253281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 659/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 23:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:57.259795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:57.361200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ccc88-7777-4157-aa7e-71001ff70356 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:57.374652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:57.395343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:57.396122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:57.396402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:57.396674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:57.403876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:57.405335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 23:28:57.418782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application with Lock( Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:28:57.419878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: ERROR keystone.server.flask.application Jul 21 23:28:57.421060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 626/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 23:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:28:57.425785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:57.474537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:57.522958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46388f51-66fa-4e2f-8945-51b057a0bf72 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:57.554900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:57.555556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:57.556340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:57.556750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:57.557568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:57.557880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:57.559292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f32cf9-ac4b-4873-9af9-a30314d7d46c None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:57.570875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 660/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 23:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:57.577535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:57.673569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38581b-6f01-4feb-a97f-356aa6ed07e6 None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:57.705951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:28:57.706582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:57.706859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:57.707132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:57.707935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] RBAC: Adding query filter params (role.id=b37eee20ec3e44b0b0d9e8ee60318b0b, scope.project.id=10357e8222ea424cab4e5c62a7b0087b, user.id=7a1a855f0a324f6b8a76bdbe18a04911) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:28:57.708241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:28:57.709677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f7118-1eca-4a96-984d-a250146a013a None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:28:57.715895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 627/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 23:28:57 2022] GET /identity/v3/role_assignments?user.id=7a1a855f0a324f6b8a76bdbe18a04911&scope.project.id=10357e8222ea424cab4e5c62a7b0087b&role.id=b37eee20ec3e44b0b0d9e8ee60318b0b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:28:59.758751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714d21-2585-458b-9eb5-45aa2e0a7305 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:59.759347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714d21-2585-458b-9eb5-45aa2e0a7305 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:59.759462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa714d21-2585-458b-9eb5-45aa2e0a7305 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:59.760814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 661/1288] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:28:59.765909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:28:59.766334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:28:59.766467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:28:59.784075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:28:59.785284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:28:59.817517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:28:59.860788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 628/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:28:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:28:59.883811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714d21-2585-458b-9eb5-45aa2e0a7305 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:28:59.983281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa714d21-2585-458b-9eb5-45aa2e0a7305 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:28:59.993739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:00.016757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:00.017514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:00.017801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:00.018079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:00.018728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:00.020093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:29:00.032310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:29:00.033563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:00.034613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 662/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:28:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:29:00.039446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:00.135316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ad4ab-8e5c-43ef-b67a-d9a027c8069d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:00.168449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:00.169106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:00.169416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:00.169692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:00.170497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:29:00.171037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:00.172426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd82a9-cb38-43e6-b7f1-83371d64420b None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:00.177598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 629/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 23:29:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:29:00.183369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:00.281653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41d962-dd82-4686-a160-6fd5ce4b47ac None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:00.315305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:00.315959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:00.316240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:00.316513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] PATH_INFO: `/v3/services` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:00.317351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:29:00.317659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:00.319059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd6581-2ce7-4bde-8341-622db1c87b8f None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:00.323942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 663/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 23:29:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:29:02.335557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3506-5055-4de7-98ab-b7af7a84985d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:02.336118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3506-5055-4de7-98ab-b7af7a84985d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:02.336118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3506-5055-4de7-98ab-b7af7a84985d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:02.337751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 630/1293] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:29:02.342832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c285a-27c1-4939-aab8-e1507f32d526 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:02.343274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c285a-27c1-4939-aab8-e1507f32d526 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:02.343382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c285a-27c1-4939-aab8-e1507f32d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:02.360399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ea7c285a-27c1-4939-aab8-e1507f32d526 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:29:02.361535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ea7c285a-27c1-4939-aab8-e1507f32d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:29:02.390529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:02.427176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 664/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:29:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:29:02.451138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3506-5055-4de7-98ab-b7af7a84985d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:02.482350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:02.553136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3506-5055-4de7-98ab-b7af7a84985d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:02.587955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:02.588603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:02.588878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:02.589148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:02.589883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:02.591221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb184a99-394d-41f1-8cde-bc52bc1cc8e3 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:02.604183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 631/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 23:29:02 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:29:04.637056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1615c-f68a-4a3e-aa6d-9fcaa4e25aa4 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:04.637656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1615c-f68a-4a3e-aa6d-9fcaa4e25aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:04.637656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1615c-f68a-4a3e-aa6d-9fcaa4e25aa4 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:04.638996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 665/1296] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:29:04.644095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:04.644682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:04.644682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:04.661844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:29:04.663056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:29:04.733337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 632/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:29:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:29:04.755896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1615c-f68a-4a3e-aa6d-9fcaa4e25aa4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:04.867841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1615c-f68a-4a3e-aa6d-9fcaa4e25aa4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:04.902896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:04.903613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:04.903890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:04.904156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:04.904796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:04.906182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:29:04.918020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:29:04.919196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:04.920243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 666/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:29:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:29:04.925357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:04.943517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:05.025517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b4ff-b36a-4b40-bc02-61a3a72f333d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:05.058424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:05.059068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:05.059346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:05.059618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:05.060306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:29:05.060605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:05.061980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:05.067091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 633/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 23:29:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:29:05.073732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:05.104374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:05.171328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ba089-0149-4056-9d68-a7ff0e947021 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:05.204167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:05.204825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:05.205112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:05.205420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:05.206210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] RBAC: Adding query filter params (interface=public, service_id=d30ff0fef4204dfd85caf13bc3e9e4a4, region_id=RegionOne) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:29:05.206523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:05.207891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ae038-d15b-4e46-b7af-fe427eea3bfe None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:05.212905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 667/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 23:29:05 2022] GET /identity/v3/endpoints?service_id=d30ff0fef4204dfd85caf13bc3e9e4a4&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:29:05.218511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:05.297385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:05.314983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270a01-e8bc-44e5-8373-90660a4dc3db None admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:05.348117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:05.348759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:05.349037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:05.349339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:05.350003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:05.351346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a78f9-f412-499d-9db6-9d75820abd45 None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:05.358030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 634/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 23:29:05 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:29:07.372924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cdf7-fff4-4ec0-bea0-c06f886a414b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:07.373450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cdf7-fff4-4ec0-bea0-c06f886a414b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:07.373450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cdf7-fff4-4ec0-bea0-c06f886a414b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:07.374808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 668/1302] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:29:07.380031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:07.380687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:07.380837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:07.397791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:29:07.400735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:29:07.464822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 635/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:29:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 23:29:07.487246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cdf7-fff4-4ec0-bea0-c06f886a414b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:07.580542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:07.587726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cdf7-fff4-4ec0-bea0-c06f886a414b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:07.620522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:07.621334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:07.621613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:07.621883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:07.622523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:07.623926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 23:29:07.636203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 23:29:07.637430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application with Lock( Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self._enter() Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application return self.creator() Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application created_value = creator( Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: ERROR keystone.server.flask.application Jul 21 23:29:07.638490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 669/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 23:29:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 23:29:07.643338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:07.717201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:07.740036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8070e4-54ec-4717-9eca-75f88782bfa6 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:07.772917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:07.773598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:07.773881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:07.774155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] PATH_INFO: `/v3/services` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:07.774849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:29:07.775151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:07.776560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383d710-9b8c-4263-a5fd-4a89eacc988c None admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:07.783101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 636/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 23:29:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:29:07.788851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:29:07.890766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372efd6-ca04-4049-86ee-8eb778791b07 None admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:29:07.923296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:29:07.923947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:29:07.924230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:29:07.924504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:29:07.925272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:29:07.926634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebfad16-5528-4fcd-afca-2059b2ae97ad None admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:29:07.944952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 670/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 23:29:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:29:17.779375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=30 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:29:17.940609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:10.721707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31535-27aa-4c0b-9ba2-12acfb2fd07a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:10.722155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31535-27aa-4c0b-9ba2-12acfb2fd07a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:10.722382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31535-27aa-4c0b-9ba2-12acfb2fd07a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:10.724134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 637/1307] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:10.729570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee2add-c6af-4051-89fc-e3512b4be1da None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:10.730051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee2add-c6af-4051-89fc-e3512b4be1da None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:10.730148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee2add-c6af-4051-89fc-e3512b4be1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:10.839723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1bee2add-c6af-4051-89fc-e3512b4be1da None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:10.840962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1bee2add-c6af-4051-89fc-e3512b4be1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:10.989303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 671/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:11.042405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:11.042688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:11.042961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:11.044527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 638/1309] 10.222.0.57 () {54 vars in 965 bytes} [Thu Jul 21 23:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:11.050673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe03c-4cb5-4b56-8801-b6b2223fd520 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:11.050936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe03c-4cb5-4b56-8801-b6b2223fd520 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:11.051220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe03c-4cb5-4b56-8801-b6b2223fd520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:11.190151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9e2fe03c-4cb5-4b56-8801-b6b2223fd520 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:11.191390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9e2fe03c-4cb5-4b56-8801-b6b2223fd520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:11.214648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:11.293071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 672/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Jul 21 23:30:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:11.293914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:11.295708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:11.429573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e932d-43b8-4b8b-ad7f-9451c560c216 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:11.511216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:11.511779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:11.512058 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:11.512331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:11.514035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:11.575047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:11.635179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:11.636611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259029c-cd58-4721-ab86-e4c874ab17f7 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:11.657445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 639/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:30:14.029332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:14.029853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:14.029853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:14.031339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 673/1312] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:14.039453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708bf24-7cb4-4df9-af00-8ade1a34d998 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:14.040153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708bf24-7cb4-4df9-af00-8ade1a34d998 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:14.041145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708bf24-7cb4-4df9-af00-8ade1a34d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:14.250853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d708bf24-7cb4-4df9-af00-8ade1a34d998 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:14.252531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d708bf24-7cb4-4df9-af00-8ade1a34d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:14.362864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 640/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:14.402196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:14.403781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:14.525766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f879b49-70bd-4921-9719-80eb71589a0c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:14.609076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:14.612334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:14.613302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:14.613750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:14.614267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:14.616082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:14.744101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:14.745606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dea97-6e7a-49fc-9047-4c41fc7e337a service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:14.766664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 674/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:17.141347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:17.141808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:17.141903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:17.143229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 641/1315] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:17.148561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5de2-7c8b-4a5a-864e-7dd747d439fd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:17.148989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5de2-7c8b-4a5a-864e-7dd747d439fd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:17.149121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff5de2-7c8b-4a5a-864e-7dd747d439fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:17.213310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f8ff5de2-7c8b-4a5a-864e-7dd747d439fd None None] MFA Rules not processed for user `120c2cefa7e94fae908b308dac4f5403`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:17.214525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f8ff5de2-7c8b-4a5a-864e-7dd747d439fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:17.266013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:17.311116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 675/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:17.351907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:17.353510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:17.363215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:17.459554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305164c6-834d-4942-99cd-8abbd5caacbd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:17.531922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:17.532572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:17.532860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:17.533140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:17.534831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:17.596571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:17.643312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:17.644735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857b42c-cf2e-4aab-834d-f60ded20637a service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:17.663459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 642/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:20.315399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4968b3-150d-415b-821c-9b651678387d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:20.315928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4968b3-150d-415b-821c-9b651678387d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:20.316024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4968b3-150d-415b-821c-9b651678387d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:20.317977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 676/1318] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:20.323213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c5ee-3c9f-4e18-bc1d-1acb61a14a6d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:20.323638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c5ee-3c9f-4e18-bc1d-1acb61a14a6d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:20.323764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c5ee-3c9f-4e18-bc1d-1acb61a14a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:20.389061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e008c5ee-3c9f-4e18-bc1d-1acb61a14a6d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:20.390210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e008c5ee-3c9f-4e18-bc1d-1acb61a14a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:20.484150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 643/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:20.526931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4968b3-150d-415b-821c-9b651678387d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:20.528460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ae4968b3-150d-415b-821c-9b651678387d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:20.632649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4968b3-150d-415b-821c-9b651678387d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:20.705133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:20.705726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:20.706004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:20.706274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:20.708939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:20.717150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:20.822637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:20.824609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2d902-14d7-4e76-9070-d6068aff80db service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:20.848137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 677/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:23.586044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:23.586812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:23.586812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:23.587962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 644/1321] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:23.593662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e103b-276a-406e-be74-47a774a52e52 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:23.594161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e103b-276a-406e-be74-47a774a52e52 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:23.594443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e103b-276a-406e-be74-47a774a52e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:23.669075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2b6e103b-276a-406e-be74-47a774a52e52 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:23.670344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2b6e103b-276a-406e-be74-47a774a52e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:23.730436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:23.779744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 678/1322] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:23.819853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:23.821449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:23.844685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:23.962893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e728c3-90b6-4f09-a555-3350d76cf776 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:24.045847 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:24.046601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:24.046950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:24.047292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:24.049049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:24.125923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:24.165946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:24.167302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344091cc-07cb-4ff6-858f-911be19e4925 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:24.185056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 645/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:26.316274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:26.317380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:26.317380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:26.318758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 679/1324] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:26.323889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5681f-5485-4033-9949-63c29f69a7fe None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:26.324317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5681f-5485-4033-9949-63c29f69a7fe None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:26.324570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5681f-5485-4033-9949-63c29f69a7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:26.390927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5de5681f-5485-4033-9949-63c29f69a7fe None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:26.392133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5de5681f-5485-4033-9949-63c29f69a7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:26.491904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 646/1325] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:26.529044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:26.530614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:26.637904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e209ff-c6f2-44f8-b8ac-fe339818b411 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:26.719464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:26.720112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:26.720390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:26.720660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:26.722344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:26.739698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:26.845541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:26.847025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6267e0-551e-4a9e-8209-40b6405c1fb5 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:26.867402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 680/1326] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:29.032975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:29.033517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:29.033517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:29.034887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 647/1327] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:29.040965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466b61-c94c-4ebc-8e00-0361c5e959a0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:29.041459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466b61-c94c-4ebc-8e00-0361c5e959a0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:29.041551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466b61-c94c-4ebc-8e00-0361c5e959a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:29.137551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-32466b61-c94c-4ebc-8e00-0361c5e959a0 None None] MFA Rules not processed for user `120c2cefa7e94fae908b308dac4f5403`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:29.138910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-32466b61-c94c-4ebc-8e00-0361c5e959a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:29.208396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:29.245977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 681/1328] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:29.284944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:29.287310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:29.344510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:29.442245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87df9cc-0787-4dee-8a21-1643149ba75a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:29.558483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:29.561097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:29.561436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:29.561726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:29.567663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:29.695838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:29.735285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:29.736758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32910689-dd9f-4e1a-a68a-c9db07cb5d03 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:29.758485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 648/1329] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:32.105267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530676-4b84-4396-a476-c721be8746bc None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:32.105843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530676-4b84-4396-a476-c721be8746bc None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:32.105843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530676-4b84-4396-a476-c721be8746bc None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:32.107127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 682/1330] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:32.112690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc995ac-0e93-43e2-9047-3b911315955d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:32.113149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc995ac-0e93-43e2-9047-3b911315955d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:32.113290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc995ac-0e93-43e2-9047-3b911315955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:32.185826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7bc995ac-0e93-43e2-9047-3b911315955d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:32.187022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7bc995ac-0e93-43e2-9047-3b911315955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:32.287180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 649/1331] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:32.340503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:32.340789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:32.341098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:32.342535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 683/1332] 10.222.0.57 () {54 vars in 965 bytes} [Thu Jul 21 23:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:32.349387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51648bf-6abe-4e31-a547-6e4f8262fba7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:32.349678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51648bf-6abe-4e31-a547-6e4f8262fba7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:32.349988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51648bf-6abe-4e31-a547-6e4f8262fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:32.395841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:32.429044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c51648bf-6abe-4e31-a547-6e4f8262fba7 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:32.430341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c51648bf-6abe-4e31-a547-6e4f8262fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:32.507931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 650/1333] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Jul 21 23:30:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:30:32.517242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:32.518777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:32.626815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffd537-b0f7-484a-861f-e501d32c5271 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:32.703090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:32.703681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:32.703965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:32.704239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:32.705948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:32.736025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:32.820759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:32.822284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31289330-c2c5-46ed-8fe0-516a59464edb service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:32.841591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 684/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:35.176646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:35.177144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:35.177144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:35.178559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 651/1335] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:35.183645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ada170-eae9-4d45-9625-db806d4d3564 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:35.184064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ada170-eae9-4d45-9625-db806d4d3564 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:35.184213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ada170-eae9-4d45-9625-db806d4d3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:35.251509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-30ada170-eae9-4d45-9625-db806d4d3564 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:35.252984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-30ada170-eae9-4d45-9625-db806d4d3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:35.330072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:35.354720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 685/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:35.396343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:35.397910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:35.509397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1eba-70d7-4a72-a274-74001d6c8f59 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:35.541834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:35.589882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:35.590524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:35.590810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:35.591084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:35.592722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:35.704442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:35.706086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee107650-b921-428e-b105-94dcef7776cc service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:35.724368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 652/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:38.452696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:38.453233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:38.453233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:38.454556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 686/1338] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:38.460180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c8317-f8b5-4665-a498-defcb433cf9b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:38.460576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c8317-f8b5-4665-a498-defcb433cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:38.460773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c8317-f8b5-4665-a498-defcb433cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:38.525115 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c84c8317-f8b5-4665-a498-defcb433cf9b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:38.526359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c84c8317-f8b5-4665-a498-defcb433cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:38.534579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:38.623636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 653/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:38.660873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:38.662420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:38.767953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d457e-32ef-42f8-b5af-e2988f06dfcf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:38.841053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:38.841731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:38.842015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:38.842292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:38.843943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:38.878856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:38.951154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:38.952585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9514702-f579-4c92-b7bf-fce4222e016b service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:38.969965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 687/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:43.101675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:43.102187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:43.102279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:43.103595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 654/1341] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:43.109062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d889-7c7c-45c7-9308-e9d62f97c55a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:43.109528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d889-7c7c-45c7-9308-e9d62f97c55a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:43.109662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d889-7c7c-45c7-9308-e9d62f97c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:43.181262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e834d889-7c7c-45c7-9308-e9d62f97c55a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:43.182391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e834d889-7c7c-45c7-9308-e9d62f97c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:43.272216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:43.284094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 688/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:43.324038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:43.325674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:43.428905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989f228-6d6f-4362-a5c7-587955e9d4e8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:43.466342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:43.506119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:43.506772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:43.507052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:43.507321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:43.508960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:43.620617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:43.622087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b87da1-eb48-451a-a879-f0b6e7b8435e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:43.640981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 655/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:46.294490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:46.295095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:46.295095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:46.296725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 689/1344] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:46.302955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd471-53da-498f-a62f-bc0f5c27c34d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:46.303494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd471-53da-498f-a62f-bc0f5c27c34d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:46.303494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd471-53da-498f-a62f-bc0f5c27c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:46.374694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e08dd471-53da-498f-a62f-bc0f5c27c34d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:46.375842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e08dd471-53da-498f-a62f-bc0f5c27c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:46.395811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:46.480781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 656/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:46.519350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:46.520962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:46.623765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d33f-dc85-452a-8917-e3b3629cf04d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:46.696586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:46.697158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:46.697466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:46.697739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:46.699371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:46.742157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:46.817960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:46.819673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ba318-dd8c-49c3-b47d-e3ab554402e4 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:46.842419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 690/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:30:50.849708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:50.850243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:50.850243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:50.851741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 657/1347] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:50.857559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802d0a-34df-48a6-9727-756baf7bc984 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:50.858041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802d0a-34df-48a6-9727-756baf7bc984 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:50.858139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc802d0a-34df-48a6-9727-756baf7bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:50.924713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dc802d0a-34df-48a6-9727-756baf7bc984 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:50.925952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dc802d0a-34df-48a6-9727-756baf7bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:51.042583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:51.045533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 691/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:30:51.083652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:30:51.085381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:51.198845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15225df5-f338-44e2-8d3e-9b2203009780 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:30:51.250617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:51.277776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:30:51.278439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:51.278726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:51.279002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:51.280690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:51.398786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:30:51.400234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24622155-725f-4f6a-a92f-aaffc1572a6d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:30:51.419002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 658/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:30:56.406080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8203-835b-43de-a2d3-4f0da6baac55 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:56.406605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8203-835b-43de-a2d3-4f0da6baac55 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:56.406696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d8203-835b-43de-a2d3-4f0da6baac55 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:56.408279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 692/1350] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:30:56.414998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128289-1261-449c-a1b3-4b82263ab404 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:30:56.416119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128289-1261-449c-a1b3-4b82263ab404 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:30:56.416404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128289-1261-449c-a1b3-4b82263ab404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:30:56.567054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5e128289-1261-449c-a1b3-4b82263ab404 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:30:56.568849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5e128289-1261-449c-a1b3-4b82263ab404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:30:56.598865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:30:56.711215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 659/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:30:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:00.844200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a403b-6504-4315-9ac5-57a9fbb1cf48 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:00.844799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a403b-6504-4315-9ac5-57a9fbb1cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:00.844799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a403b-6504-4315-9ac5-57a9fbb1cf48 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:00.846325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 693/1352] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:00.851758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7196f-e7f6-4818-bf5e-18564cc63bd4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:00.852224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7196f-e7f6-4818-bf5e-18564cc63bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:00.852324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7196f-e7f6-4818-bf5e-18564cc63bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:00.936839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-15a7196f-e7f6-4818-bf5e-18564cc63bd4 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:00.938076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-15a7196f-e7f6-4818-bf5e-18564cc63bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:01.011974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:01.050862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 660/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:31:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:02.370711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11ce6-b8c3-4f71-ae83-d497cbbac494 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:02.371211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11ce6-b8c3-4f71-ae83-d497cbbac494 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:02.371211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c11ce6-b8c3-4f71-ae83-d497cbbac494 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:02.372556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 694/1354] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:02.377595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf605e3-47a4-485e-9d12-1414ebb5bc59 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:02.378302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf605e3-47a4-485e-9d12-1414ebb5bc59 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:02.378401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf605e3-47a4-485e-9d12-1414ebb5bc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:02.456373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0cf605e3-47a4-485e-9d12-1414ebb5bc59 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:02.457600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0cf605e3-47a4-485e-9d12-1414ebb5bc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:02.564336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 661/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:31:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:06.077361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2079390-0e2e-4dcd-8491-7c30ce3cf165 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:06.078205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2079390-0e2e-4dcd-8491-7c30ce3cf165 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:06.078647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2079390-0e2e-4dcd-8491-7c30ce3cf165 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:06.081109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 695/1356] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:06.087106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c3b1-445c-498e-8088-10ed889fde10 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:06.087907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c3b1-445c-498e-8088-10ed889fde10 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:06.088334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c3b1-445c-498e-8088-10ed889fde10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:06.138667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.177101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c642c3b1-445c-498e-8088-10ed889fde10 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:06.178787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c642c3b1-445c-498e-8088-10ed889fde10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:06.289228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 662/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:06.342250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:06.342540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:06.342821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:06.344200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 696/1358] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 23:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:06.353454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9627-6ab4-49f3-b146-88b567477e9b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:06.353753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9627-6ab4-49f3-b146-88b567477e9b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:06.354037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9627-6ab4-49f3-b146-88b567477e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:06.440582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-197a9627-6ab4-49f3-b146-88b567477e9b None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:06.441807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-197a9627-6ab4-49f3-b146-88b567477e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:06.493402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.565368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 663/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 23:31:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:31:06.573641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:06.575714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:06.739608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766c361-af7b-447c-ab52-09c581a3c21b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:06.827253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:06.871908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:06.872560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:06.872840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:06.873113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:06.874832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:06.976604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:06.978255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c5c71-813e-4ce3-b16c-519b204db1c5 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:06.997026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 697/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:09.271907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:09.272518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:09.272646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:09.274183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 664/1361] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:09.279628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22eeed-95be-4a94-aef1-831c4ba170f9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:09.280086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22eeed-95be-4a94-aef1-831c4ba170f9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:09.280217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22eeed-95be-4a94-aef1-831c4ba170f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:09.350230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8c22eeed-95be-4a94-aef1-831c4ba170f9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:09.351440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8c22eeed-95be-4a94-aef1-831c4ba170f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:09.392620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:09.463796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 698/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:09.508774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:09.510397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:09.699662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496a1b-c34c-4f90-b1ad-cd1b1fae38be None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:09.715586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:09.831959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:09.832714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:09.833065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:09.833628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:09.835275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:09.930780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:09.932315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63da06-536b-4b82-a8fd-dce84e2299aa service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:09.951486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 665/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:12.355249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa162b9-9f70-4f69-a7d8-fe93f8cf12a8 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:12.355811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa162b9-9f70-4f69-a7d8-fe93f8cf12a8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:12.355811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa162b9-9f70-4f69-a7d8-fe93f8cf12a8 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:12.358326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 699/1364] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:12.363208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6733a4-24cf-4dea-944f-8a9435088167 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:12.363655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6733a4-24cf-4dea-944f-8a9435088167 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:12.363762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6733a4-24cf-4dea-944f-8a9435088167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:12.380074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:12.440385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2c6733a4-24cf-4dea-944f-8a9435088167 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:12.441640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2c6733a4-24cf-4dea-944f-8a9435088167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:12.547875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 666/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:31:12.595066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:12.595358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:12.595638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:12.597144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 700/1366] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 23:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:12.603314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91d30-193d-401d-9cfb-5b094c039cf3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:12.603679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91d30-193d-401d-9cfb-5b094c039cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:12.604030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e91d30-193d-401d-9cfb-5b094c039cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:12.692605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8e91d30-193d-401d-9cfb-5b094c039cf3 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:12.694131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8e91d30-193d-401d-9cfb-5b094c039cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:12.732878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:12.829233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 667/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 23:31:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:12.837217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:12.838815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:13.006188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade367e7-a926-4b4c-b649-382cb1ba0a28 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:13.027185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:13.134303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:13.134970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:13.135242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:13.135517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:13.137297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:13.239576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:13.241149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5025-ac63-4e1e-b2ac-5cc8d1e6a3cc service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:13.261464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 701/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:31:14.244344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f91f-b4d7-4953-b0ee-30c94bdea96c None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:14.244900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f91f-b4d7-4953-b0ee-30c94bdea96c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:14.244900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8f91f-b4d7-4953-b0ee-30c94bdea96c None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:14.246273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 668/1369] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:14.251630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a9b8-0aba-499e-ae71-204c9437b70f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:14.252064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a9b8-0aba-499e-ae71-204c9437b70f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:14.252384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455a9b8-0aba-499e-ae71-204c9437b70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:14.283909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:14.321283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d455a9b8-0aba-499e-ae71-204c9437b70f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:14.322632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d455a9b8-0aba-499e-ae71-204c9437b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:14.428614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 702/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:14.770998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:14.772224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:14.772224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:14.773370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 669/1371] 10.222.0.57 () {54 vars in 964 bytes} [Thu Jul 21 23:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:14.778034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893196-e207-4e56-b1ee-a6af4bde379b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:14.778391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893196-e207-4e56-b1ee-a6af4bde379b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:14.778733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a893196-e207-4e56-b1ee-a6af4bde379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:14.858121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5a893196-e207-4e56-b1ee-a6af4bde379b None None] MFA Rules not processed for user `265bce5d41794e74833b744b83bd669a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:14.859452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5a893196-e207-4e56-b1ee-a6af4bde379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:14.909048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:14.944635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 703/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Jul 21 23:31:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:14.951984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:14.953569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:15.072007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08bc49-0321-4cfd-83e3-00ff87bc21da None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:15.119813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:15.156182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:15.156879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:15.157158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:15.157455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:15.159086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:15.275613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:15.278180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67e6a-8e87-4975-bbbd-300ebf99b609 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:15.298722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 670/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:15.384740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:15.385410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:15.385511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:15.387893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 704/1374] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:15.392756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9a2e-06e8-4474-bdd8-a4931fb7284c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:15.393050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9a2e-06e8-4474-bdd8-a4931fb7284c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:15.393761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9a2e-06e8-4474-bdd8-a4931fb7284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:15.467641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-92bd9a2e-06e8-4474-bdd8-a4931fb7284c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:15.468929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-92bd9a2e-06e8-4474-bdd8-a4931fb7284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:15.491758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:15.572723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 671/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:15.619279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:15.620756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:15.776243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702d72-7315-4a5f-afeb-ba4541130085 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:15.827633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:15.891880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:15.892538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:15.892819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:15.893166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:15.894934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:15.987440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:15.989390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d1a73-a186-43a1-8737-fa8d8217b510 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:16.008558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 705/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:18.080193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:18.080741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:18.080741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:18.082163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 672/1377] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:18.087895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c5e8-6a75-4e2b-bc6f-7517900db211 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:18.088338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c5e8-6a75-4e2b-bc6f-7517900db211 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:18.088444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772c5e8-6a75-4e2b-bc6f-7517900db211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:18.156482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6772c5e8-6a75-4e2b-bc6f-7517900db211 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:18.157734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6772c5e8-6a75-4e2b-bc6f-7517900db211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:18.164814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:18.268489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 706/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:18.320987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:18.322466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:18.471419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089c1d7-0a18-40b4-81dd-ed80bcabd976 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:18.476013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:18.594142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:18.594725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:18.595014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:18.595299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:18.596994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:18.704031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:18.707441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c336f-26da-4cdd-a339-df836696df59 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:18.732093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 673/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:20.858230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:20.858836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:20.858836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:20.860510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 707/1380] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:20.866717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989259ed-e8e0-42e8-beaf-8acedf648f4a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:20.867317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989259ed-e8e0-42e8-beaf-8acedf648f4a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:20.867317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989259ed-e8e0-42e8-beaf-8acedf648f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:20.878163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:20.938489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-989259ed-e8e0-42e8-beaf-8acedf648f4a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:20.939295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-989259ed-e8e0-42e8-beaf-8acedf648f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:21.046091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 674/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:21.093416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:21.093416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:21.241909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:21.254167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510150-cf81-4c63-a361-78c1539605d6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:21.373477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:21.374047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:21.374330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:21.374611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:21.376275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:21.471635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:21.473277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3a963-eaf7-4295-8f39-1be57319a20e service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:21.484678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:21.494326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 708/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:23.592785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:23.593437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:23.593437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:23.594750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 675/1383] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:23.601448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a6c8-82c5-44ec-97d0-a05c1a620a1b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:23.601882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a6c8-82c5-44ec-97d0-a05c1a620a1b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:23.602118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8a6c8-82c5-44ec-97d0-a05c1a620a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:23.686692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c6d8a6c8-82c5-44ec-97d0-a05c1a620a1b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:23.688353 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6d8a6c8-82c5-44ec-97d0-a05c1a620a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:23.823660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 709/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:23.874128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:23.875668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:23.970636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:24.038871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b316-ce4b-49e7-ac3c-4842859c5af2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:24.173409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:24.174445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:24.174817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:24.175164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:24.177393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:24.240343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:24.290115 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:24.291656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99979cf-6679-486b-974b-414568c7df32 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:24.313993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 676/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:31:26.946118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:26.946583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:26.946821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:26.948622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 710/1386] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:26.955084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dffeb-6277-4645-8ed5-d28ace8f4127 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:26.955519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dffeb-6277-4645-8ed5-d28ace8f4127 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:26.955793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dffeb-6277-4645-8ed5-d28ace8f4127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:27.040520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fc4dffeb-6277-4645-8ed5-d28ace8f4127 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:27.042409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fc4dffeb-6277-4645-8ed5-d28ace8f4127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:27.155349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 677/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:27.201504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:27.203491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:27.288379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:27.371225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761564c-0af5-4b67-b3b6-3fe65e65f958 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:27.513976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:27.514835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:27.515189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:27.515532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:27.517596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:27.567412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:27.622648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:27.624234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb5460-69a0-4119-943f-396507be3365 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:27.642924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 711/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:29.784307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:29.784871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:29.784871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:29.786425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 678/1389] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:29.794103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4625e0-479e-41e6-8d89-d63c2e5ad47d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:29.794103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4625e0-479e-41e6-8d89-d63c2e5ad47d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:29.794103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4625e0-479e-41e6-8d89-d63c2e5ad47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:29.868653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8a4625e0-479e-41e6-8d89-d63c2e5ad47d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:29.870038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8a4625e0-479e-41e6-8d89-d63c2e5ad47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:29.972794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 712/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:30.019118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:30.020750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:30.054841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:30.170960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a61df-1aac-4672-bf47-7e8ab83de80e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:30.274585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:30.287721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:30.288359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:30.288637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:30.288905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:30.290568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:30.380147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:30.381809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a2362-d32b-4844-99a7-c4b638464261 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:30.400200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 679/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:30.440946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba519f1-d58a-4fc8-aa20-c57ea5e17485 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:30.441304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba519f1-d58a-4fc8-aa20-c57ea5e17485 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:30.441589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba519f1-d58a-4fc8-aa20-c57ea5e17485 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:30.443060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 713/1392] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:30.448617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a2ba-65c9-4120-893a-9e1d18cbf503 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:30.448913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a2ba-65c9-4120-893a-9e1d18cbf503 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:30.449209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162a2ba-65c9-4120-893a-9e1d18cbf503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:30.525140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c162a2ba-65c9-4120-893a-9e1d18cbf503 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:30.526434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c162a2ba-65c9-4120-893a-9e1d18cbf503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:30.590766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:30.631657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 680/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:30.688068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:30.688392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:30.688675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:30.690086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 714/1394] 10.222.0.57 () {54 vars in 966 bytes} [Thu Jul 21 23:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:30.695332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418f1fa-5eb8-465f-91ae-96b1d10b0489 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:30.695621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418f1fa-5eb8-465f-91ae-96b1d10b0489 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:30.695893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418f1fa-5eb8-465f-91ae-96b1d10b0489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:30.771235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e418f1fa-5eb8-465f-91ae-96b1d10b0489 None None] MFA Rules not processed for user `953c2242e2e047eca592608753cece82`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:30.772380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e418f1fa-5eb8-465f-91ae-96b1d10b0489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:30.851054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 681/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Jul 21 23:31:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:30.858610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:30.860164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:30.873872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:30.987516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6150c-af8b-4a85-804f-8d96c16583b2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:31.063553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:31.064203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:31.064489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:31.064759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:31.066443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:31.143271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:31.186929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:31.188310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b25ece-8ae1-4cb9-bef0-9f4b54f08950 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:31.207147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 715/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:31.938915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212806-809f-46f4-bee3-a7076e9c1a4e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:31.939438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212806-809f-46f4-bee3-a7076e9c1a4e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:31.939546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212806-809f-46f4-bee3-a7076e9c1a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.004313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-61212806-809f-46f4-bee3-a7076e9c1a4e None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:32.005804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-61212806-809f-46f4-bee3-a7076e9c1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.014543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:32.096309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 682/1397] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:31:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:32.142984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:32.143495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:32.143600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.144943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 716/1398] 10.222.0.57 () {54 vars in 943 bytes} [Thu Jul 21 23:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:31:32.151899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57cd4-c258-4dec-b35d-5bf0ab8cac1c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:32.152230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57cd4-c258-4dec-b35d-5bf0ab8cac1c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:32.152536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e57cd4-c258-4dec-b35d-5bf0ab8cac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.233544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f2e57cd4-c258-4dec-b35d-5bf0ab8cac1c None None] MFA Rules not processed for user `152e60dec2154281b85d5626fd836813`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:32.234766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f2e57cd4-c258-4dec-b35d-5bf0ab8cac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.321091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:32.343710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 683/1399] 10.222.0.57 () {58 vars in 1040 bytes} [Thu Jul 21 23:31:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:32.353452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:32.355070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.494860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366722-42f9-40fb-a309-96b7e17cb1ba None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:32.521579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c06e-4f0a-4a86-abe6-e14613ff01fc None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:32.521873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c06e-4f0a-4a86-abe6-e14613ff01fc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:32.522156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c06e-4f0a-4a86-abe6-e14613ff01fc None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.523548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 684/1400] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:32.528512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:32.528804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:32.529085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.531729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:32.597177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:32.598418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.600769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:32.601535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:32.601822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:32.602101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:32.603778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.688383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:32.690031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2a447-143c-474e-a9c7-4cc6703bbe45 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:32.698224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 685/1401] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:31:32.698385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 717/1402] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:31:32.744769 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:32.746142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:32.817393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:32.879689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16ffb-84c8-46be-ad9c-c1b032e2e70f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:33.003274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:33.004412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:33.004702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:33.004974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:33.008117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:33.075105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:33.124480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:33.126182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258be9e-64ca-40aa-9d0e-063b9d8beb40 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:33.148275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 686/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:35.256525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:35.257114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:35.257114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:35.258657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 718/1404] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:35.263862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac856-4e14-4a5a-8fa3-24c1e67b460f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:35.264366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac856-4e14-4a5a-8fa3-24c1e67b460f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:35.264475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac856-4e14-4a5a-8fa3-24c1e67b460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:35.340197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b67ac856-4e14-4a5a-8fa3-24c1e67b460f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:35.341537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b67ac856-4e14-4a5a-8fa3-24c1e67b460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:35.455780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 687/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:35.501866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:35.503393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:35.582007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:35.664280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0495c44-d2fc-4dcc-97bb-cbe73b80fa55 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:35.787424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:35.788078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:35.788358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:35.788637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:35.790314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:35.829249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:35.900226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:35.901949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fffb-cbc8-4bbf-a416-f12656b567d1 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:35.922168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 719/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:38.089315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:38.089315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:38.089315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:38.089315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 688/1407] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:31:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:38.090113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26032-3648-4c3b-8bff-b01e2711aa1d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:38.090113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26032-3648-4c3b-8bff-b01e2711aa1d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:38.090113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b26032-3648-4c3b-8bff-b01e2711aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:38.180279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-61b26032-3648-4c3b-8bff-b01e2711aa1d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:38.181677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-61b26032-3648-4c3b-8bff-b01e2711aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:38.291652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 720/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:31:38.337973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:38.339927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:38.389129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:38.511835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfa9ed-5404-4b43-94af-61902db247da None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:38.636346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:38.642535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:38.643185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:38.643464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:38.643735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:38.645422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:38.749711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:38.751327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a0707-78f8-4fa7-b4b0-9000ab7069d9 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:38.773665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 689/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:48.289630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:48.769655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=47 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:55.053948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348943d-0f7e-4e4f-b1cc-24eb66a47c97 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:55.054505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348943d-0f7e-4e4f-b1cc-24eb66a47c97 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:55.054505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348943d-0f7e-4e4f-b1cc-24eb66a47c97 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:55.055994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 721/1410] 10.222.0.57 () {54 vars in 918 bytes} [Thu Jul 21 23:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:55.061311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f55d-d76e-4df4-ab4f-d9cc9284f48e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:55.061720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f55d-d76e-4df4-ab4f-d9cc9284f48e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:55.061858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f55d-d76e-4df4-ab4f-d9cc9284f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:55.139479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c1e7f55d-d76e-4df4-ab4f-d9cc9284f48e None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:55.140684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1e7f55d-d76e-4df4-ab4f-d9cc9284f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:55.247177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 690/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 21 23:31:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:55.262541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e630-08fa-4be5-bdc2-5636d4c3fc49 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:55.262541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e630-08fa-4be5-bdc2-5636d4c3fc49 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:55.262541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6e630-08fa-4be5-bdc2-5636d4c3fc49 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:55.264193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 722/1412] 10.222.0.57 () {54 vars in 918 bytes} [Thu Jul 21 23:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:55.268922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469230-9302-4842-8071-3186a89b16fd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:55.269255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469230-9302-4842-8071-3186a89b16fd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:55.269539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469230-9302-4842-8071-3186a89b16fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:55.340444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:55.344169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-24469230-9302-4842-8071-3186a89b16fd None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:55.345962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-24469230-9302-4842-8071-3186a89b16fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:55.462336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 691/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 21 23:31:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:57.950107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:57.950632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:57.950781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:57.952076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:57.957401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b84d3-b506-4281-9c8b-4d07e592fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:57.957868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b84d3-b506-4281-9c8b-4d07e592fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:57.957971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b84d3-b506-4281-9c8b-4d07e592fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:58.023952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-989b84d3-b506-4281-9c8b-4d07e592fbb8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:58.025225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-989b84d3-b506-4281-9c8b-4d07e592fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:58.080417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:58.123884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:58.168123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:58.169862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:58.315611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf9fd3-8ec1-4e90-98a9-fd46d4216ea0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:58.386249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:58.426433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:31:58.427240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:58.427520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:58.427797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:58.429516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:58.518169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:31:58.519756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c048f-51d1-4a1a-a907-e259184937c8 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:31:58.538447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 724/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:31:59.439627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:59.440175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:59.440175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:59.441612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:31:59.446974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d001e45-cc9c-44b5-8b40-f7a21ad4a116 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:31:59.447358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d001e45-cc9c-44b5-8b40-f7a21ad4a116 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:31:59.447534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d001e45-cc9c-44b5-8b40-f7a21ad4a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:31:59.528989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5d001e45-cc9c-44b5-8b40-f7a21ad4a116 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:31:59.530242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5d001e45-cc9c-44b5-8b40-f7a21ad4a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:59.556612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:31:59.626442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:31:59.774583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:31:59.776104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:31:59.921453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da6cbb-9bf2-4efe-a3a8-48ed06154664 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:31:59.963685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:00.037890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:00.038460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:00.038741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:00.039012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:00.040651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:00.130569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:00.132180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6ca5-543b-44bb-92af-f918f47bf47b service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:00.150205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 694/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:01.029918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:01.030429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:01.030551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:01.031841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:01.037243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2879e-f1b1-46c1-b885-9807fe51f3fd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:01.037653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2879e-f1b1-46c1-b885-9807fe51f3fd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:01.037857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2879e-f1b1-46c1-b885-9807fe51f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:01.090303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:01.112681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6dc2879e-f1b1-46c1-b885-9807fe51f3fd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:01.113924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6dc2879e-f1b1-46c1-b885-9807fe51f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:01.211050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:01.361954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:01.363484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:01.509239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12fbf7-c9e1-448e-a33f-4e0ec3665c15 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:01.520911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:01.620388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:01.621032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:01.621340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:01.621616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:01.623242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:01.709266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:01.710839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a14097-7ea2-4f7e-8a1e-e111cc92d73b service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:01.728868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 727/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:02.592504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:02.593044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:02.593044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:02.594470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:02.599818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd181-b6e3-4f1d-8a9c-53e3e721dfbd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:02.600333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd181-b6e3-4f1d-8a9c-53e3e721dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:02.600445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd181-b6e3-4f1d-8a9c-53e3e721dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:02.619063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:02.674858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3b8fd181-b6e3-4f1d-8a9c-53e3e721dfbd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:02.676049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3b8fd181-b6e3-4f1d-8a9c-53e3e721dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:02.773504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:02.925526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:02.927609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:03.038024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:03.074635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f45ae0-69c0-4af8-a389-ac4023e44dc1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:03.187833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:03.188405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:03.188691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:03.188969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:03.190665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:03.266733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:03.281077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:03.282711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd30d9c-f56e-473f-a4cf-e421ca2c1bfe service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:03.300860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 697/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:04.167114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:04.171652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:04.171941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:04.173397 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:04.178721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33252-7f3f-4f25-851e-740669028da1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:04.179148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33252-7f3f-4f25-851e-740669028da1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:04.179282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33252-7f3f-4f25-851e-740669028da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:04.252536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d8a33252-7f3f-4f25-851e-740669028da1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:04.254030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d8a33252-7f3f-4f25-851e-740669028da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:04.350172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:04.499932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:04.501491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:04.585810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:04.648061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed412f1e-94c5-4aeb-80eb-4739d50afe23 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:04.760313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:04.760872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:04.761150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:04.761449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:04.763096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:04.810086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:04.852429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:04.854060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81facdec-323c-430f-9ce4-1c679d3069eb service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:04.872408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 730/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:05.681452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:05.682039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:05.682039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:05.683354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:05.688296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f231-e784-4039-852f-2e7e79ff402f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:05.688728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f231-e784-4039-852f-2e7e79ff402f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:05.688835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f231-e784-4039-852f-2e7e79ff402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:05.763297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-55e4f231-e784-4039-852f-2e7e79ff402f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:05.764491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-55e4f231-e784-4039-852f-2e7e79ff402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:05.861112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:06.012051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:06.013617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:06.062302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:06.159768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c8b64-a0da-42b7-bd6c-7b039f114e0e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:06.270647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:06.271922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:06.272208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:06.272483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:06.274167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:06.280966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:06.362097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:06.363736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ade7b-e086-40ec-ba2e-5456455feaef service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:06.383479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 700/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:07.189706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398bc13-46d1-482f-9724-7938c205038d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:07.190274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398bc13-46d1-482f-9724-7938c205038d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:07.190274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398bc13-46d1-482f-9724-7938c205038d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:07.191624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:07.196637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fa7d-af32-4466-80b3-31dd5cdbf857 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:07.197080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fa7d-af32-4466-80b3-31dd5cdbf857 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:07.197211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6fa7d-af32-4466-80b3-31dd5cdbf857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:07.273729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-28c6fa7d-af32-4466-80b3-31dd5cdbf857 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:07.274926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-28c6fa7d-af32-4466-80b3-31dd5cdbf857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:07.342772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:07.373346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:07.525059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398bc13-46d1-482f-9724-7938c205038d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:07.526566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6398bc13-46d1-482f-9724-7938c205038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:07.543730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:07.670514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398bc13-46d1-482f-9724-7938c205038d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:07.760762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:07.787665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:07.788282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:07.788583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:07.788886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:07.790530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:07.879264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:07.881549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed0289-d7ab-4c93-8584-f4531b4e6261 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:07.899701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 733/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:08.719410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:08.719975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:08.719975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:08.721367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:08.726510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7c2-4fc3-4068-aa26-150823d1ed81 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:08.726911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7c2-4fc3-4068-aa26-150823d1ed81 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:08.727100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa7c2-4fc3-4068-aa26-150823d1ed81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:08.799905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3d0fa7c2-4fc3-4068-aa26-150823d1ed81 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:08.801107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3d0fa7c2-4fc3-4068-aa26-150823d1ed81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:08.843851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:08.900085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:09.049578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:09.051186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:09.198599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7c2a4-09ee-48aa-8410-06ef5c1a344d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:09.252971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:09.311505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:09.312084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:09.312366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:09.312637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:09.314336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:09.404143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:09.405854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2bde2-5b22-4175-86c7-dac722ad2f96 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:09.424483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 703/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:10.231584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:10.232110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:10.232110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:10.233536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:10.238383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f334f-e523-43f8-88c8-3dbc68f9c78d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:10.238817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f334f-e523-43f8-88c8-3dbc68f9c78d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:10.238922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f334f-e523-43f8-88c8-3dbc68f9c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:10.315416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c18f334f-e523-43f8-88c8-3dbc68f9c78d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:10.316650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c18f334f-e523-43f8-88c8-3dbc68f9c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:10.319006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:10.415682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:10.563762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:10.565305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:10.713117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fea587-14e8-49e8-aa8c-ea58edb73c87 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:10.738669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:10.827203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:10.827853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:10.828133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:10.828408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:10.830120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:10.919025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:10.920624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5387c50-9a5e-4e6f-89e7-7f07be2b137e service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:10.938800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 736/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:12.897153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:12.897743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:12.897743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:12.899231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:12.904475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84701101-1a3c-416b-95ad-dbf6fbbe2100 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:12.904894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84701101-1a3c-416b-95ad-dbf6fbbe2100 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:12.905040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84701101-1a3c-416b-95ad-dbf6fbbe2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:12.944679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:12.970496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-84701101-1a3c-416b-95ad-dbf6fbbe2100 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:12.971743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-84701101-1a3c-416b-95ad-dbf6fbbe2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:13.066435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:13.105800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:13.107459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:13.216041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf42fe1-2247-4463-8259-c561f3ed15f2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:13.249560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:13.294294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:13.294941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:13.295221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:13.295493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:13.297121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:13.407638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:13.409092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea14d03-05f8-432f-a914-42c91306422f service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:13.427932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 706/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:15.706780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:15.707346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:15.707346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:15.709365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:15.714568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e790b8-ac63-4297-a5fe-44eec5303625 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:15.715000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e790b8-ac63-4297-a5fe-44eec5303625 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:15.715138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e790b8-ac63-4297-a5fe-44eec5303625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:15.779240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e7e790b8-ac63-4297-a5fe-44eec5303625 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:15.780442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e7e790b8-ac63-4297-a5fe-44eec5303625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:15.793726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:15.879459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:15.918527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:15.920094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:16.023410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a293c1-89ea-4fa9-8840-668c8be7b13c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:16.040773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:16.102180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:16.102831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:16.103109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:16.103376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:16.105011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:16.215071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:16.216505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898ff5-c14c-4649-8bc8-f68f74e6fa4e service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:16.233969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 739/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:18.595194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:18.595771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:18.595771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:18.597111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:18.603296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b87c-af89-443d-9302-1019ee5d3066 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:18.603730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b87c-af89-443d-9302-1019ee5d3066 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:18.603861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b87c-af89-443d-9302-1019ee5d3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:18.650449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:18.668551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e760b87c-af89-443d-9302-1019ee5d3066 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:18.669798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e760b87c-af89-443d-9302-1019ee5d3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:18.765916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:18.804621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:18.806198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:18.909750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29a9de-ec09-42ce-8df9-c6bd7ec0de3a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:18.950088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:18.984766 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:18.985442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:18.985727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:18.986005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:18.987648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:19.094920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:19.096358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06304630-1c46-4e7b-a8e9-5dfdcfecc0df service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:19.114915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 709/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:21.288067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:21.288634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:21.288634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:21.290038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:21.295310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d5-ec51-44be-aeae-3253c846b06a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:21.295700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d5-ec51-44be-aeae-3253c846b06a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:21.295872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d5-ec51-44be-aeae-3253c846b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:21.360009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c593f7d5-ec51-44be-aeae-3253c846b06a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:21.361229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c593f7d5-ec51-44be-aeae-3253c846b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:21.382740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:21.460272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:21.499647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:21.501292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:21.603944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f8100-8f7b-4615-ae08-7ad3e16e792a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:21.623384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:21.676437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:21.677113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:21.677421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:21.677698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:21.679367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:21.787744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:21.789176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e78932-84d8-4120-9d1f-9588ef52b987 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:21.809886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 742/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:24.028732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:24.029377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:24.029377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:24.030700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:24.035875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709620-cb5a-4d52-a3bb-edc6521b71bd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:24.037327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709620-cb5a-4d52-a3bb-edc6521b71bd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:24.037327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00709620-cb5a-4d52-a3bb-edc6521b71bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:24.099207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:24.101971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-00709620-cb5a-4d52-a3bb-edc6521b71bd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:24.103323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-00709620-cb5a-4d52-a3bb-edc6521b71bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:24.200274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:24.238051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:24.240177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:24.344099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5de75-dda7-41dd-980b-3c769c308dd3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:24.397759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:24.423836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:24.424475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:24.424753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:24.425020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:24.426681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:24.539125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:24.540679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba122f-4722-4f6d-81d3-c5794a7297b8 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:24.559021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 712/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:26.773429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:26.774003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:26.774003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:26.775361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:26.780711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8b87-4b0a-4c90-af2f-d249380733ba None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:26.781117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8b87-4b0a-4c90-af2f-d249380733ba None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:26.781290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8b87-4b0a-4c90-af2f-d249380733ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:26.855880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cbad8b87-4b0a-4c90-af2f-d249380733ba None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:26.857109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cbad8b87-4b0a-4c90-af2f-d249380733ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:26.886862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:26.959005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:26.997381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:26.998983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:27.106207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968e89b-072d-41f3-9683-cb0db3a5953b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:27.136305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:27.182724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:27.183374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:27.183654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:27.183931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:27.185959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:27.295222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:27.296575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ebe0a-077b-4316-b11d-85db1b560a2c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:27.315201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 745/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:29.402342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:29.402872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:29.402989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:29.404286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:29.409543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4425-899f-43b8-8567-75dd1194cdde None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:29.409975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4425-899f-43b8-8567-75dd1194cdde None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:29.410102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f4425-899f-43b8-8567-75dd1194cdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:29.477559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c45f4425-899f-43b8-8567-75dd1194cdde None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:29.478788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c45f4425-899f-43b8-8567-75dd1194cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:29.486842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:29.579192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:29.616992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:29.618566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:29.724524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815aff-52b8-4ee7-b7d9-4452e4828b26 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:29.779388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:29.798014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:29.798659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:29.798941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:29.799213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:29.800857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:29.908607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:29.909989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9de7-eaa4-46e2-9441-714f9447fc64 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:29.928459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 715/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:32.033698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:32.034241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:32.034241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:32.035645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:32.040807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12869-50eb-4233-9cf8-bfcb762b9400 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:32.041283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12869-50eb-4233-9cf8-bfcb762b9400 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:32.041419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef12869-50eb-4233-9cf8-bfcb762b9400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:32.113267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-aef12869-50eb-4233-9cf8-bfcb762b9400 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:32.115008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aef12869-50eb-4233-9cf8-bfcb762b9400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:32.153339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:32.213775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:32.251486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:32.253045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:32.356167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea1bd3-950d-4f1f-bd3c-768dbfb370f0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:32.393883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:32.430598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:32.431252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:32.431534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:32.431809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:32.433499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:32.539993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:32.541514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b750f8-5f75-4a23-ba7a-e1c75d5aafd1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:32.560058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 748/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:34.612185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:34.612746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:34.612746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:34.614146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:34.619469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e341-33c3-4ac7-b849-a57d62a160e7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:34.619897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e341-33c3-4ac7-b849-a57d62a160e7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:34.620026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e341-33c3-4ac7-b849-a57d62a160e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:34.684708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7682e341-33c3-4ac7-b849-a57d62a160e7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:34.685962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7682e341-33c3-4ac7-b849-a57d62a160e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:34.703805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:34.783839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:34.821688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:34.823274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:34.928034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26462b-b779-4a79-9293-d426bb018f7e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:34.994217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:35.001310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:35.001955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:35.002238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:35.002515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:35.004423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:35.114061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:35.115514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c5daf-5a7c-4178-8ec3-89c9c58d77f1 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:35.133771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 718/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:37.202929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:37.203548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:37.203548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:37.204889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:32:37.210960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18728-d88c-45c3-8814-750598d91164 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:37.211402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18728-d88c-45c3-8814-750598d91164 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:37.211513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa18728-d88c-45c3-8814-750598d91164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:37.276363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-faa18728-d88c-45c3-8814-750598d91164 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:37.277613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-faa18728-d88c-45c3-8814-750598d91164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:37.326173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:37.375431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:37.413390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:37.414957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:37.518568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0768b-ec4e-47b1-84dd-5edb5df157a9 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:37.565452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:37.592926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:37.593616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:37.593904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:37.594180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:37.595840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:37.704533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:37.706001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5489-c8e2-4edd-a711-fcbd0eb379af service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:37.724656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 751/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:32:47.373549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=22 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:47.722319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=66 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:57.577532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015578-4123-424e-8b8a-94fbc9a3aea8 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:57.578103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015578-4123-424e-8b8a-94fbc9a3aea8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:57.578103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d015578-4123-424e-8b8a-94fbc9a3aea8 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:57.579452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 720/1471] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:57.585260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6162-54f3-43a6-b99d-eb5984381af7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:57.585686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6162-54f3-43a6-b99d-eb5984381af7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:57.585815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6162-54f3-43a6-b99d-eb5984381af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:57.649796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-56aa6162-54f3-43a6-b99d-eb5984381af7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:57.651009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-56aa6162-54f3-43a6-b99d-eb5984381af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:57.746166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 752/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:32:57.832436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:57.832663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:57.832937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:57.835006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 721/1473] 10.222.0.57 () {54 vars in 966 bytes} [Thu Jul 21 23:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:32:57.839868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f917ef-7033-470b-bc03-6c2945bee0c2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:57.840164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f917ef-7033-470b-bc03-6c2945bee0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:57.840567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f917ef-7033-470b-bc03-6c2945bee0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:57.915505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-70f917ef-7033-470b-bc03-6c2945bee0c2 None None] MFA Rules not processed for user `953c2242e2e047eca592608753cece82`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:32:57.916717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-70f917ef-7033-470b-bc03-6c2945bee0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:57.942044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:57.995010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 753/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Jul 21 23:32:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:32:58.002828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:32:58.004623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:58.109471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3756-ee91-45da-a553-acb0781d2ea4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:32:58.183039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:32:58.183686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:32:58.183970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:32:58.184248 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:32:58.185925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:32:58.239081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:32:58.295064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:32:58.296505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06e48-ae88-4d36-a257-5684faea68ed service glance] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:32:58.315156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 722/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:00.455526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:00.456063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:00.456063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:00.457410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 754/1476] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:00.462802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48653-77b4-4bc3-8482-497bf246fd99 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:00.463235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48653-77b4-4bc3-8482-497bf246fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:00.463350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48653-77b4-4bc3-8482-497bf246fd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:00.527472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8cb48653-77b4-4bc3-8482-497bf246fd99 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:00.528676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8cb48653-77b4-4bc3-8482-497bf246fd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:00.624021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 723/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:00.648163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:00.649724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:00.773987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d97c-bc6b-4eb7-afc0-8db8fc4bffda None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:00.823759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:00.868923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:00.869608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:00.869888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:00.870160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:00.870883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:00.872706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:33:00.872706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:33:00.872706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:33:00.873871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d576d7e-5d6d-4c29-ba03-7aeae971a5a5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:00.892587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 755/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 23:33:00 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:33:02.940427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:02.940989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:02.940989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:02.942433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 724/1479] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:02.948288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceec22-94ba-4723-83eb-cded0db4b9cd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:02.948700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceec22-94ba-4723-83eb-cded0db4b9cd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:02.948853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ceec22-94ba-4723-83eb-cded0db4b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:03.014574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-20ceec22-94ba-4723-83eb-cded0db4b9cd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:03.015811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-20ceec22-94ba-4723-83eb-cded0db4b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:03.114365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 756/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:03.157691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:03.159427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:03.170298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:03.306073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84055e-a79b-40c2-9764-7366990ade21 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:03.386387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:03.420606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:03.421300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:03.421586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:03.421859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:03.423531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:03.511687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:03.513328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edbcd0-8f12-4911-ad10-b3487d539761 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:03.531481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 725/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:05.776055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:05.776618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:05.776618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:05.778090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 757/1482] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:05.783488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1b99-7696-419e-a3aa-29a7f74d52d6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:05.783935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1b99-7696-419e-a3aa-29a7f74d52d6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:05.784095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1b99-7696-419e-a3aa-29a7f74d52d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:05.855142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bfbb1b99-7696-419e-a3aa-29a7f74d52d6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:05.856366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bfbb1b99-7696-419e-a3aa-29a7f74d52d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:05.902488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:05.953200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 726/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:05.990233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:05.991755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:06.015479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:06.099644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593b9c1-8d3e-4128-912e-0745e89d754e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:06.173857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:06.174502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:06.174780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:06.175053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:06.176800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:06.251876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:06.287177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:06.288620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d07d-12f8-418c-8beb-4c7cde12d122 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:06.307276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 758/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:08.398692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:08.399222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:08.399222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:08.400540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 727/1485] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:08.405692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2749c-8fce-4cfa-a31b-f7a89be7f2a8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:08.406133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2749c-8fce-4cfa-a31b-f7a89be7f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:08.406238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2749c-8fce-4cfa-a31b-f7a89be7f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:08.471552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9ec2749c-8fce-4cfa-a31b-f7a89be7f2a8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:08.472769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9ec2749c-8fce-4cfa-a31b-f7a89be7f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:08.568155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 759/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:08.606250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:08.607830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:08.710982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c4ea-571e-4ca0-87c7-14151bef1a15 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:08.781771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:08.783548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:08.784183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:08.784662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:08.785150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:08.787703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:08.897995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:08.899428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6d7e-d779-449e-b071-a8afc7153e17 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:08.917161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 728/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:11.104390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:11.104954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:11.105177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:11.107035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 760/1488] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:11.112940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e4918-3cb5-4d15-a41e-7d075dcb0a83 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:11.113425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e4918-3cb5-4d15-a41e-7d075dcb0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:11.113533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e4918-3cb5-4d15-a41e-7d075dcb0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:11.182534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5f8e4918-3cb5-4d15-a41e-7d075dcb0a83 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:11.183759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5f8e4918-3cb5-4d15-a41e-7d075dcb0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:11.236449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:11.284282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 729/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:11.325840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:11.327422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:11.362924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:11.434345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed129bcc-7502-43b1-ae8a-759b27dac49e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:11.507546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:11.508194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:11.508474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:11.508748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:11.510459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:11.588826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:11.618401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:11.619855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20c94d-1607-42f5-96ab-25cc303b418f service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:11.638278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 761/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:13.880820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:13.881387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:13.881387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:13.882787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 730/1491] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 23:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:33:13.888878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532774-59ba-4a87-a7e0-fa9de9b94227 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:13.889303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532774-59ba-4a87-a7e0-fa9de9b94227 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:13.889466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51532774-59ba-4a87-a7e0-fa9de9b94227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:13.953828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-51532774-59ba-4a87-a7e0-fa9de9b94227 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:33:13.955037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-51532774-59ba-4a87-a7e0-fa9de9b94227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:14.051499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 762/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 23:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:33:14.091539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:33:14.093068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:14.200658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedbf12-40cd-416d-b61a-f6b648b02e0f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:33:14.276899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:33:14.277565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:33:14.277848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:33:14.278119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:33:14.279753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:33:14.289069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:14.389736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:33:14.391208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89cf4f-aad8-4643-8b50-c2af7763345f service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:33:14.409522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 731/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:33:24.049642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=82 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:33:24.407307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=50 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:49.065495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:49.066500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:49.067053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:49.142216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:34:49.143412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:49.240323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 763/1494] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:34:49.248590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:49.249075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:49.249228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:49.323341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:34:49.324460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:49.418827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 732/1495] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:34:49.423573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:49.424826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:49.436726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d080b-c73b-46d7-9953-2f058f92e84a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:49.497202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:49.530735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:49.531400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:49.531684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:49.531960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:49.532678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:34:49.532984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:49.534040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:49.534040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:34:49.534040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:34:49.535432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:49.546441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 764/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:34:49.555548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:49.564652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac671267-db68-41c8-b253-256dd77e4cff None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:49.625404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:49.659114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:49.660304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:49.660642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:49.660947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:49.661681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:49.663486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:49.663486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:34:49.663486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:34:49.664707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:49.720239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 733/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:34:49 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:34:49.725161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:49.726724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:49.760302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3b7f-5e59-4721-b8b6-24806ba96a14 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:49.853517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:49.854175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:49.854454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:49.854723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:49.855422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:49.856427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:49.856427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:34:49.856427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:34:49.857642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:49.897066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 765/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:34:49 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:34:49.901089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:49.902695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:49.963933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538129a5-56cf-40fc-9549-c7b22cf39f09 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:50.047311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:50.059078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:50.059743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.060025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.060300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.061024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:50.062073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:50.062073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:34:50.062073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:34:50.062947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:50.075510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 734/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:34:50.079540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:50.081096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:50.093374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885720-d614-4c5e-af85-e7df44bdf9db admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:50.119307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:50.194934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:50.195529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.195817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.196092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.196814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:50.197856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:50.197856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:34:50.197856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:34:50.198740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619c61-ad0f-45c1-8e2b-2e70c1726dfa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:50.211768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 766/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:34:50.215994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:50.217577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:50.251140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e778-a0c2-4905-ba96-3ac4fd87e0b2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:50.344363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:50.345269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.345550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.345819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] PATH_INFO: `/v3/projects/824241906e214d70b7ed2cad4f7f8a64/users/704dc50fda4b4c45b3b69041fca6fe89/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.368242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824241906e214d70b7ed2cad4f7f8a64, user_id=704dc50fda4b4c45b3b69041fca6fe89, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:50.369293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:50.369293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:34:50.369293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:34:50.371238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd6652-6c7e-484c-a908-80e38ef64e44 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:50.395189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 735/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:34:50 2022] PUT /identity/v3/projects/824241906e214d70b7ed2cad4f7f8a64/users/704dc50fda4b4c45b3b69041fca6fe89/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:34:50.407307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b944-ecad-4fb0-bc72-4d594028b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.407599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b944-ecad-4fb0-bc72-4d594028b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.407874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b944-ecad-4fb0-bc72-4d594028b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.462176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0b76b944-ecad-4fb0-bc72-4d594028b7f0 None None] MFA Rules not processed for user `704dc50fda4b4c45b3b69041fca6fe89`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:34:50.463311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0b76b944-ecad-4fb0-bc72-4d594028b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:50.540591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 767/1502] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:34:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:34:50.555100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.555389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.555669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.557095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 736/1503] 10.222.0.57 () {54 vars in 964 bytes} [Thu Jul 21 23:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:34:50.561749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b6fd-98d2-4993-a215-6f78b7b8bf17 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.562044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b6fd-98d2-4993-a215-6f78b7b8bf17 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.562327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b6fd-98d2-4993-a215-6f78b7b8bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.591964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:50.636686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-db89b6fd-98d2-4993-a215-6f78b7b8bf17 None None] MFA Rules not processed for user `265bce5d41794e74833b744b83bd669a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:34:50.637963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-db89b6fd-98d2-4993-a215-6f78b7b8bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:50.713495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 768/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Jul 21 23:34:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:34:50.721128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:50.722808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:50.773464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:50.827713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bb662-eb2a-446d-bba8-d184a4edabce None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:50.900011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:50.900653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:50.900938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:50.901242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:50.902907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:51.122235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:51.123667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:51.127170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:51.142919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 737/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:34:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:34:51.184772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3c10-da9c-49ce-9f60-b0ddc63f4762 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:51.185214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3c10-da9c-49ce-9f60-b0ddc63f4762 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:51.185361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff3c10-da9c-49ce-9f60-b0ddc63f4762 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:51.186650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 769/1506] 10.222.0.57 () {52 vars in 829 bytes} [Thu Jul 21 23:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:34:51.190028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:51.191761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:51.288133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a566c5e-8483-497b-9512-1c437a02a7bc service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:51.380386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:51.381210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:51.381502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:51.381780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] PATH_INFO: `/v3/users/704dc50fda4b4c45b3b69041fca6fe89` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:51.394111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=704dc50fda4b4c45b3b69041fca6fe89)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:51.395133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:51.395133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:34:51.395133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:34:51.396336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:51.405840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:51.459756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704dc50fda4b4c45b3b69041fca6fe89'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:51.468525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704dc50fda4b4c45b3b69041fca6fe89'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:51.480604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704dc50fda4b4c45b3b69041fca6fe89'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:51.499129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704dc50fda4b4c45b3b69041fca6fe89'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:51.499581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704dc50fda4b4c45b3b69041fca6fe89'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:51.506201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 738/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:34:51 2022] DELETE /identity/v3/users/704dc50fda4b4c45b3b69041fca6fe89 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:34:51.510720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:51.511008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:51.511283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:51.564692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:34:51.566501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:51.641242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:51.653684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 770/1508] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:34:51.663275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:51.664479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:51.768026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934d3ad-e69b-4c6c-8d58-29563ea8c3dc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:51.821742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:34:51.843105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:51.843753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:51.844034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:51.844304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:51.845982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:51.960403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:51.961841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e86e2-ad7a-41d3-93fa-020798d176fc service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:51.980481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 739/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:34:52.303072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:34:52.304400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:34:52.316192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f790bd8-6d6a-45c6-a119-902235ed2d91 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:34:52.420280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:34:52.421145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:34:52.421472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:34:52.421746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] PATH_INFO: `/v3/projects/824241906e214d70b7ed2cad4f7f8a64` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:34:52.431440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824241906e214d70b7ed2cad4f7f8a64)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:34:52.432495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:34:52.432495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:34:52.432495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:34:52.433737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:34:52.506325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824241906e214d70b7ed2cad4f7f8a64', 'request_id': 'req-eed4275a-d728-481c-9240-77af5b6d1069'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:52.512216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824241906e214d70b7ed2cad4f7f8a64', 'request_id': 'req-eed4275a-d728-481c-9240-77af5b6d1069'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:52.525846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824241906e214d70b7ed2cad4f7f8a64', 'request_id': 'req-eed4275a-d728-481c-9240-77af5b6d1069'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:52.550672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] The token cache is being invalidate because project 824241906e214d70b7ed2cad4f7f8a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:34:52.550957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:52.551461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eed4275a-d728-481c-9240-77af5b6d1069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:34:52.552818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 771/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:34:52 2022] DELETE /identity/v3/projects/824241906e214d70b7ed2cad4f7f8a64 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:35:01.978132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=62 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:35:02.548603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:29.185892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:29.186464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:29.186464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:29.187856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:29.192900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fa715-e94e-4725-a337-d231a99e2fa3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:29.193406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fa715-e94e-4725-a337-d231a99e2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:29.193512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fa715-e94e-4725-a337-d231a99e2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:29.272373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8d4fa715-e94e-4725-a337-d231a99e2fa3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:29.273605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8d4fa715-e94e-4725-a337-d231a99e2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:29.376149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:29.531558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:29.534271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:29.654558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd01e7-c071-41ad-80ad-d0fc8701c039 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:29.660405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:29.661058 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:29.661372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:29.661653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:29.670006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:29.671589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343284-8407-4eea-95d1-76e2f48bc468 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:29.681736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 741/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:30.529096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7cbe-96d0-425b-8095-7838dc3d7318 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:30.529658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7cbe-96d0-425b-8095-7838dc3d7318 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:30.529771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e7cbe-96d0-425b-8095-7838dc3d7318 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:30.531163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:30.536927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab909a-65ea-452d-adbc-092c0365946c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:30.537412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab909a-65ea-452d-adbc-092c0365946c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:30.537508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab909a-65ea-452d-adbc-092c0365946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:30.556581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-68ab909a-65ea-452d-adbc-092c0365946c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:30.557879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-68ab909a-65ea-452d-adbc-092c0365946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:30.566082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:30.722165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7cbe-96d0-425b-8095-7838dc3d7318 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:30.736783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e7cbe-96d0-425b-8095-7838dc3d7318 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:30.742120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:30.742751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:30.743030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:30.743310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:30.751313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:30.753848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed201012-f654-43e6-9bdd-6155ae07fb2c service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:30.763178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 774/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:31.057425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210841-8482-4b70-b132-a2760b6c8b73 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:31.057716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210841-8482-4b70-b132-a2760b6c8b73 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:31.057980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a210841-8482-4b70-b132-a2760b6c8b73 None None] PATH_INFO: `/v3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:31.059310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 743/1517] 10.222.0.39 () {54 vars in 925 bytes} [Thu Jul 21 23:36:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:36:31.065621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a79-caef-46fa-ba26-c42f391053ba None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:31.065985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a79-caef-46fa-ba26-c42f391053ba None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:31.066331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba3a79-caef-46fa-ba26-c42f391053ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:31.135555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a7ba3a79-caef-46fa-ba26-c42f391053ba None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:31.137091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a7ba3a79-caef-46fa-ba26-c42f391053ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:31.156478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:31.215494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 775/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 21 23:36:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:34.947842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea389-eaff-4a06-88f4-d430524e1257 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:34.948359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea389-eaff-4a06-88f4-d430524e1257 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:34.948359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ea389-eaff-4a06-88f4-d430524e1257 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:34.949726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 744/1519] 10.222.0.57 () {54 vars in 961 bytes} [Thu Jul 21 23:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:34.954777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795208b9-1a6c-4ddb-b185-3e951c88bf8d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:34.955332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795208b9-1a6c-4ddb-b185-3e951c88bf8d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:34.955435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795208b9-1a6c-4ddb-b185-3e951c88bf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:34.974681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-795208b9-1a6c-4ddb-b185-3e951c88bf8d None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:34.975892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-795208b9-1a6c-4ddb-b185-3e951c88bf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:34.984425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 776/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Jul 21 23:36:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:34.992288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea389-eaff-4a06-88f4-d430524e1257 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:35.006495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ea389-eaff-4a06-88f4-d430524e1257 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:35.011478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:35.012116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:35.012400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:35.012677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:35.021784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:35.023410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63e4b3-cdc1-4a74-b89d-bb3a5438ad70 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:35.033972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 745/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:41.987443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decbdf-bd17-4c9f-bd44-c712adadcd88 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:41.987989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decbdf-bd17-4c9f-bd44-c712adadcd88 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:41.987989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6decbdf-bd17-4c9f-bd44-c712adadcd88 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:41.989394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:41.994107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87e69-5f13-45c7-a7f0-a9ec7f3f400a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:41.994536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87e69-5f13-45c7-a7f0-a9ec7f3f400a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:41.994664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a87e69-5f13-45c7-a7f0-a9ec7f3f400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:42.013004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-71a87e69-5f13-45c7-a7f0-a9ec7f3f400a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:42.014294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71a87e69-5f13-45c7-a7f0-a9ec7f3f400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:42.022704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:42.174259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6decbdf-bd17-4c9f-bd44-c712adadcd88 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:42.188442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6decbdf-bd17-4c9f-bd44-c712adadcd88 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:42.194521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:42.195162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:42.195447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:42.195725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:42.203886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:42.206089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6aa65-06bd-451a-a421-fb96002631be service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:42.215491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 778/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:43.048138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889d1-764c-4f3e-b34c-894256d42f28 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:43.048704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889d1-764c-4f3e-b34c-894256d42f28 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:43.048704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8889d1-764c-4f3e-b34c-894256d42f28 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:43.050772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 23:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:43.056136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3a0d3-404b-4c2a-92f2-ad33baff96a7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:43.056585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3a0d3-404b-4c2a-92f2-ad33baff96a7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:43.056729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3a0d3-404b-4c2a-92f2-ad33baff96a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:43.201446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4ca3a0d3-404b-4c2a-92f2-ad33baff96a7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:43.202666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4ca3a0d3-404b-4c2a-92f2-ad33baff96a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:43.210454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 23:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:43.363328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8889d1-764c-4f3e-b34c-894256d42f28 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:43.378582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8889d1-764c-4f3e-b34c-894256d42f28 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:43.384008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:43.384643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:43.384923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:43.385223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:43.393513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:43.395084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aebf0-8c4d-454d-94c5-994d35abdfe5 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:43.404726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 748/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:47.248649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:47.249222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:47.249222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:47.250633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:47.256579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093a65-8707-41bf-99e9-109020d217f9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:47.256992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093a65-8707-41bf-99e9-109020d217f9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:47.257130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a093a65-8707-41bf-99e9-109020d217f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:47.276495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6a093a65-8707-41bf-99e9-109020d217f9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:47.277719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6a093a65-8707-41bf-99e9-109020d217f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:47.285639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:36:47.359010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:47.360748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:47.437340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7aade-f93b-4f50-a649-e2114c2e4c6a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:47.441309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:47.441953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:47.442234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:47.442506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:47.451316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:47.452735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509d4fb-3baf-41e5-bbf3-684302ceead2 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:47.462652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 781/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:49.503048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46217fb7-896b-40d6-a048-d1d08b4666a8 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:49.503617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46217fb7-896b-40d6-a048-d1d08b4666a8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:49.503617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46217fb7-896b-40d6-a048-d1d08b4666a8 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:49.504985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:49.510432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90481-eaec-4efd-8c08-32fcbfddbbbf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:49.510884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90481-eaec-4efd-8c08-32fcbfddbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:49.510991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b90481-eaec-4efd-8c08-32fcbfddbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:49.528969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f9b90481-eaec-4efd-8c08-32fcbfddbbbf None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:49.530184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f9b90481-eaec-4efd-8c08-32fcbfddbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:49.538823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:49.575002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46217fb7-896b-40d6-a048-d1d08b4666a8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:49.585958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46217fb7-896b-40d6-a048-d1d08b4666a8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:49.589495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:49.590138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:49.590420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:49.590694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:49.600127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:49.601592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f63a7-b3e2-4210-8376-e8565be26244 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:49.611581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 751/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:53.050754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:53.051331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:53.051331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:53.052667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:53.057757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9882-0570-47e8-8d19-f2caa014b432 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:53.058160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9882-0570-47e8-8d19-f2caa014b432 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:53.058299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d9882-0570-47e8-8d19-f2caa014b432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:53.065574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=81 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:53.077907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-545d9882-0570-47e8-8d19-f2caa014b432 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:53.079146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-545d9882-0570-47e8-8d19-f2caa014b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:53.087463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:53.400352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:53.402048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:53.468355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:36:53.482167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891bfe9-8b88-4cc6-bbff-f8b4b6c69e04 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:53.486322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:53.486970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:53.487253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:53.487527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:53.496412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:53.497867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d1a28-bf68-4345-807f-8964b8dc301f service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:53.507548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 784/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:36:55.574811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:55.575415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:55.575415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:55.576736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 23:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:36:55.582503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3a93-900e-4118-9900-77d212f1ed5f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:55.582959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3a93-900e-4118-9900-77d212f1ed5f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:55.583087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3a93-900e-4118-9900-77d212f1ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:55.600612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b55b3a93-900e-4118-9900-77d212f1ed5f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:36:55.601962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b55b3a93-900e-4118-9900-77d212f1ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:55.609806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 23:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:36:55.912327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:36:55.914154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:36:55.927719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74525-742c-47fe-b2ab-da661fe02a47 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:36:55.931215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:36:55.931845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:36:55.932124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:36:55.932396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:36:55.941828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:36:55.943243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950cd8-d7af-460e-8a33-0fea6ce7eb8c service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:36:55.952494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 754/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:37:05.595699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=11 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:37:05.948420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:23.791532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.795123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.795123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:23.815087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:23.816313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:23.828780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 786/1540] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:23.837761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef645-43e8-4209-99a7-78e87f2f7d24 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.838318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef645-43e8-4209-99a7-78e87f2f7d24 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.838318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef645-43e8-4209-99a7-78e87f2f7d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:23.866836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dbdef645-43e8-4209-99a7-78e87f2f7d24 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:23.868038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dbdef645-43e8-4209-99a7-78e87f2f7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:23.886811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 755/1541] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:23.893007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:23.906317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6dd2-7b8c-4f6e-88cb-6c49b5aa5c54 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.906641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6dd2-7b8c-4f6e-88cb-6c49b5aa5c54 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.906875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6dd2-7b8c-4f6e-88cb-6c49b5aa5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:23.907769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604de94f-be57-495d-bb79-d6b8e9a9cb70 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:23.918814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:23.919485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.919791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.920295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:23.921022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:23.922396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:23.924009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:23.941135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a37b6dd2-7b8c-4f6e-88cb-6c49b5aa5c54 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:23.942493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a37b6dd2-7b8c-4f6e-88cb-6c49b5aa5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:23.947623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 787/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:23.956785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:23.969446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 756/1543] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:23.971633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addff9d9-ec96-42bb-a4a0-7c00b6ba52b3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:23.983401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:23.984095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.984376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.984644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:23.985385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:23.986581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:23.986581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:38:23.986581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:38:23.987777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:23.995164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adda74-5ff4-4f1a-a91f-3aef7320b057 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:23.995530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adda74-5ff4-4f1a-a91f-3aef7320b057 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:23.995719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adda74-5ff4-4f1a-a91f-3aef7320b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.038268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a2adda74-5ff4-4f1a-a91f-3aef7320b057 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.039507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a2adda74-5ff4-4f1a-a91f-3aef7320b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.062533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 757/1544] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:24.064624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.064915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.065210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.067287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 788/1545] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:23 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:38:24.068196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.113691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.115464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.216329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 758/1546] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.218646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.228152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeadb7-8859-40f2-87fe-482138ec2256 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.229948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94240be-3c7b-4186-8f25-18ff7333291f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.238505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.239361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.240283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.241207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.241710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.242192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.243099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.243589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.244071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.245009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.246262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:24.246262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:38:24.246262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:38:24.246941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.250192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa5626-88a4-4cc3-b1be-891043703400 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.251626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae090e-1386-4c5f-91ba-1f1b6f25d672 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.276647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 789/1547] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.277905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322336-f47f-41ff-afbd-be7265272c0e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.278249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322336-f47f-41ff-afbd-be7265272c0e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.278535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14322336-f47f-41ff-afbd-be7265272c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.288380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 759/1548] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.290048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454032-4e26-495b-ae52-7fbff4cacff1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.290573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454032-4e26-495b-ae52-7fbff4cacff1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.291063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab454032-4e26-495b-ae52-7fbff4cacff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.308209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-14322336-f47f-41ff-afbd-be7265272c0e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.308209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-14322336-f47f-41ff-afbd-be7265272c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.318311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ab454032-4e26-495b-ae52-7fbff4cacff1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.320883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ab454032-4e26-495b-ae52-7fbff4cacff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.327037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 790/1549] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.328429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.328729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.329011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.331908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 760/1550] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.333257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.333544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.333818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.350113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.351507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.351665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.352663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.360627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 791/1551] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.361243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 761/1552] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.361432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.366050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.371839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2fec4-57e3-48e1-881c-c426f1ae4502 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.376684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74841b5b-39d8-4925-b991-a53e2f2d95b9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.378094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.378747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.379024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.379295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.379979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.381448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.381906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78464c-b3cf-4dc2-ba65-c99a64f6e615 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.382159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.382450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.382727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.383452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.385039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1b81d-c048-4871-a453-7291e919f12b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.395672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 762/1553] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:24.396889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2f04-3980-40b0-979e-d9263bd6a7e8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.397176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2f04-3980-40b0-979e-d9263bd6a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.397476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc2f04-3980-40b0-979e-d9263bd6a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.412853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 792/1554] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.412853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddc63-720a-46ed-aef2-2610c818e5ae None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.412853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddc63-720a-46ed-aef2-2610c818e5ae None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.412853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddc63-720a-46ed-aef2-2610c818e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.417872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b0bc2f04-3980-40b0-979e-d9263bd6a7e8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.419083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b0bc2f04-3980-40b0-979e-d9263bd6a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.429760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0d7ddc63-720a-46ed-aef2-2610c818e5ae None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.430943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0d7ddc63-720a-46ed-aef2-2610c818e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.477898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 763/1555] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.478998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.479288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.479563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.493526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 793/1556] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.494825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4a1-4904-45ba-92ba-702f43df0cb1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.495114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4a1-4904-45ba-92ba-702f43df0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.495392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6e4a1-4904-45ba-92ba-702f43df0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.500276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.501533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.510632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 764/1557] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.511292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.514896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9fe6e4a1-4904-45ba-92ba-702f43df0cb1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.516092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9fe6e4a1-4904-45ba-92ba-702f43df0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.521138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ba52e-a6e5-4db6-83ca-db4db11a8e2c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.523970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 794/1558] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.525173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.525485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.525760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.526339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.527092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.527561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.527848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.528603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.528914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.530965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:24.530965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:38:24.530965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:38:24.531902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.532452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:24.545751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 765/1559] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.545942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.546555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.547145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.555690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 795/1560] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.556450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.558315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89bf4b-ef1a-4ed6-a713-669ca0d730d0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.563412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.564066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.564352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.564631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.565382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.566110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3edf0-5460-4d2f-b070-37a39dc2bb8b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.566979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f804d97-2f31-4122-92dc-e9936a8a0965 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.570897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.571487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.571770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.572047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.572792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.574720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4e71f-62b0-47df-bed3-c44ee80e91e1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.582512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 766/1561] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:24.582512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.582512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.582512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.597477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 796/1562] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.599078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.599236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.599444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.599652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.600681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.608811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 767/1563] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.609739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.614838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:24.617847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:24.619074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:24.621045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba702e-d37d-4f4a-87d4-6d429f46902c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.626424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.627055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.627336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.627610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.627705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 797/1564] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:24.631586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.631689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.631797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.631797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.640912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff4fc-eb2b-4c92-bd69-098a2bc31244 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.645148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 768/1565] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.645694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.646211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.646385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.646618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.646891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.647611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.647914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.649533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.656434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c0aef-50ea-497d-94b4-370d1ed5299a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.661111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.668459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 798/1566] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.668651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.668651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.668651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.668949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.669050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.669050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.674278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd0b2-47ff-4200-81b6-ea3fe6d15c4f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.678875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.679647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.679937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.680214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.680926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.681315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.683199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.692537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 769/1567] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.694989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.704478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 799/1568] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.704478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.714201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dee55-5e27-4ca7-a8d1-ac8baccaf9cf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.759274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a711d-407e-40d7-8c6d-7137bf236754 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.764838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.765748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.766037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.766315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] PATH_INFO: `/v3/projects/9612b265be6144809add4ce9e14ff6ee/users/51def40a3de745a99f67c6ef2d2bcbf6/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.771618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.772285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.772563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.772837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.773588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.775176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.781452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9612b265be6144809add4ce9e14ff6ee, user_id=51def40a3de745a99f67c6ef2d2bcbf6, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.784077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.785551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 800/1569] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:24.786751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.797482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db119c-d62a-43c7-b979-dadd0cf9a832 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.798152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 770/1570] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:24 2022] PUT /identity/v3/projects/9612b265be6144809add4ce9e14ff6ee/users/51def40a3de745a99f67c6ef2d2bcbf6/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:24.802378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.855273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.856025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.856305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.856580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.857362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.857672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.859269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.865099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e6a6-90fe-433c-af85-03ad5387fb4e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.870605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 801/1571] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.870722 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.871323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.871606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.871881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.872601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:24.873571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.875562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.878232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.895388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 771/1572] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:24.895388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.895708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c274e1-409d-4957-b1a7-8ae0fce86d74 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.899208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468394b-7d45-4ce8-84e0-f033fc47683f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:24.899525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.900224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.900519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.900830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.901554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.903500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.904595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:24.905288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:24.905573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:24.905877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:24.906588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:24.908527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:24.930477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 802/1573] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.931384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.939370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 772/1574] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:24.940304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:24.944987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:24.969237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:24.998719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f037e2-9d6d-4fef-95b9-fcf23e84a24d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.003841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.004631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.004941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.005241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.005935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.007841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.008045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f668a0c-3bac-4183-beed-6c576180be1e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.012724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.013466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.013781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.014085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.014770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.016855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412bff63-6e92-4b1b-a697-a3a79138e495 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.027583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 803/1575] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.028399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.039149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9f6bf-f95c-441e-94d5-9ecd8e81c218 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.043737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.043871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 773/1576] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:24 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.044395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.045279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.045554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.045694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.046090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.046364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.046464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.047991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.058434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 804/1577] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.059327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.067093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:25.068350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:25.069272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82ee0d-21ae-4ca6-8ba3-da938982ee13 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.127344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.128072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.128294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.128568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.129294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.131215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.132537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 774/1578] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:25.133524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.143439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc589f1-0321-4843-b5f4-d7a150a35b92 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.148449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.149109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.149425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.149697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.150382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.152589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.164124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 805/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.164124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.182808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 775/1580] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.182808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.226996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e486dd-05fd-4d19-9918-567fd60d5e53 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.242137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd4fb3-9937-46c5-b342-04d9781f69da admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.246811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.247247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.247489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.247908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.248586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.249685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.251801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.275091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 776/1581] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.275091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.283168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beaefe-7466-485e-a31b-5ea53c4efc12 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.287768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.288462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.288689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.288967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.289721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.291307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.292760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.293466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.293750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.294023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.294767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.296945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.301813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 777/1582] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.305007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.308494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.313114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3ca2-3f0f-4cd9-b09d-0fa801aed1fc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.321603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 806/1583] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.321771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.321771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.321985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.322075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.322075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.322075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.322865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.332732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38681d02-55ba-4b9e-9071-6e72dd915800 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.338728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.339976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.340261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.340538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] PATH_INFO: `/v3/projects/c1883e9325554192a01b12c38acad014/users/2a672b88402a4db083626778d522ecb6/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.346824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 778/1584] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.346824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.358140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1883e9325554192a01b12c38acad014, user_id=2a672b88402a4db083626778d522ecb6, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.359193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:25.359193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:38:25.359193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:38:25.361104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.376560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 807/1585] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:25 2022] PUT /identity/v3/projects/c1883e9325554192a01b12c38acad014/users/2a672b88402a4db083626778d522ecb6/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:25.377296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.412122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4ab06-d1ae-4b28-a97c-df5a6b012ed0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.439126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e418d-9ded-4b85-83c8-991f01978d87 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.443750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.444409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.444685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.444955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.445668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.447579 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.464664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.465351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.465650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.465916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.472159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 808/1586] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.472159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.479359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.480788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.481598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba598a-e4f3-4202-b552-f3148bf0d9e0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.486739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.487379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.487656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.487931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.488595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.490492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.491677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 779/1587] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:25.492472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.503742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25aca-79e5-4b62-9aad-b41be8f1c445 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.509416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.510082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.510364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.510730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.511562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.513040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 809/1588] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:25.513227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.514281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.524930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 780/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.525782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576db970-e2a0-4637-b904-756e7d7ca82d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.525994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.532180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.534476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.534476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.534476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.535082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.536864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.538637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877ce21-3de6-40dd-9471-559813ea199a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.543316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.543973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.544261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.544641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.546166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.547788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf2aa-5f85-4959-8cbc-9e49269e97c9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.549733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 810/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.550426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.561021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d8ad-5f09-4060-bf03-39f3a49df473 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.562713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 781/1591] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.563830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.564124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.564406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.569463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.570135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.570534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.570745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.571645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.573320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.585777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 811/1592] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.586792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.596024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] MFA Rules not processed for user `2a672b88402a4db083626778d522ecb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:25.597313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:25.598132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebe143-c1a2-4eac-bf30-f8c6ad868e3a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.603942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.604865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.605312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.606363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.606498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.609249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.622615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 812/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.624106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.635994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c11cf-6bd1-4d43-aea0-f5e2a56d91a4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.640902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.641694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.642051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.642788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.643345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.644892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.661395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 813/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.661395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.668956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a16839-b371-4725-85c2-c055f13c78b7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.676088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.676813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.677140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.677442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.678193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 782/1595] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:25.683275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.683596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.683773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.708198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eef6e-7edb-4b60-96f6-15472650622e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.710883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 814/1596] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.711972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.718184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.719271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.719561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.719856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] PATH_INFO: `/v3/projects/49d99b1f2c324aef91d2b56899ff631f/users/140a9484151c4904a25b6056f2e49520/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.730873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bb3c-c41e-4853-87cf-ce5df6afaeb8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.738216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.739128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.739878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.740386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.740716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.741492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.743739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.745886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:25.748915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d99b1f2c324aef91d2b56899ff631f, user_id=140a9484151c4904a25b6056f2e49520, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.752525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.762438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 815/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.764056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.770425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 783/1598] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:25 2022] PUT /identity/v3/projects/49d99b1f2c324aef91d2b56899ff631f/users/140a9484151c4904a25b6056f2e49520/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:25.771286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.780641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb4e6-f554-4a9c-8753-cb34dd87d63f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.849130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.850200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba6916-c7be-42a7-92ac-fdf0a1c09e6e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.850330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.850486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.850772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.851828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.853879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.856288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.856971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.857846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.858127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.858867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.860540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.868515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 816/1599] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.869871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.876107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 784/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.877264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.885686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ebcd8-46e9-4377-ab74-004307cf9953 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.887807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220449a-73af-43b4-8424-599ca8388072 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.892080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.892975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.893265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:25.893664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.894109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.894397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.894785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.895128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] PATH_INFO: `/v3/projects/b61e4573c34a4bb89e13f3731c181820/users/5fe7dd1aa72e42b098046c3c2aa5d4c3/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.895469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.897277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d7782-1921-4ac5-af44-50b3d8f78216 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.911190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 817/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:25.913092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61e4573c34a4bb89e13f3731c181820, user_id=5fe7dd1aa72e42b098046c3c2aa5d4c3, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:25.914628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86f5-2898-4c26-b296-3459b5a01a0f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.915135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86f5-2898-4c26-b296-3459b5a01a0f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.915626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de86f5-2898-4c26-b296-3459b5a01a0f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.916433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8654b4-ac5b-45c9-9c2d-7454780bc2c3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:25.917862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 818/1602] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 23:38:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:25.919121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de86f5-2898-4c26-b296-3459b5a01a0f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:25.938550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 785/1603] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:25 2022] PUT /identity/v3/projects/b61e4573c34a4bb89e13f3731c181820/users/5fe7dd1aa72e42b098046c3c2aa5d4c3/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:25.939972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:25.940345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:25.940691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:25.941413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de86f5-2898-4c26-b296-3459b5a01a0f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:25.965357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:25.966895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.018816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.019765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.020191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.020469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] PATH_INFO: `/v3/projects/79b6d71ecbf94b7a81761727712881ea/users/b991805cfa834aab8dcab7d94d108ee2/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.036177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b6d71ecbf94b7a81761727712881ea, user_id=b991805cfa834aab8dcab7d94d108ee2, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.040777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 786/1604] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.040777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.041043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.056034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 819/1605] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:25 2022] PUT /identity/v3/projects/79b6d71ecbf94b7a81761727712881ea/users/b991805cfa834aab8dcab7d94d108ee2/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:26.057091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.063773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a68d1-4b60-46c5-aec6-5bf253198ecc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.132340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034249c-568e-432f-83a4-45d3c1a98e73 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.134205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.135107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.135392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.135672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] PATH_INFO: `/v3/projects/fc4faed5bed7450da8122eeb77459f3a/users/c44b88237c0f4ae7a31fbaaddbb2d427/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.137959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.139522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.139860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.140011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:26.140334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] PATH_INFO: `/v3/projects/8e93cf25ed2a450795460769e656e674/users/724bd78ff04b49ff8d40e72d27ca1a05/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.149814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:26.154973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4faed5bed7450da8122eeb77459f3a, user_id=c44b88237c0f4ae7a31fbaaddbb2d427, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.158480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.161504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e93cf25ed2a450795460769e656e674, user_id=724bd78ff04b49ff8d40e72d27ca1a05, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.164997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafcab3-9aa2-48be-bc5b-2fc26df54886 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.178065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 787/1606] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:26 2022] PUT /identity/v3/projects/fc4faed5bed7450da8122eeb77459f3a/users/c44b88237c0f4ae7a31fbaaddbb2d427/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:26.180004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.183964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 820/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:26 2022] PUT /identity/v3/projects/8e93cf25ed2a450795460769e656e674/users/724bd78ff04b49ff8d40e72d27ca1a05/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:26.186711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419d983-51a4-462a-a538-5254edc1f615 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.187061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419d983-51a4-462a-a538-5254edc1f615 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.187340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419d983-51a4-462a-a538-5254edc1f615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.235085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0419d983-51a4-462a-a538-5254edc1f615 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.236646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0419d983-51a4-462a-a538-5254edc1f615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.273418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8c7a2-e78a-4d38-ad9d-acaa30a76cf7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.330025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 821/1608] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.331739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b341-9f98-4a55-85c2-d7114e1ac7dd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.332174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b341-9f98-4a55-85c2-d7114e1ac7dd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.332620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b341-9f98-4a55-85c2-d7114e1ac7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.359970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.360934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.361369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.361701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] PATH_INFO: `/v3/projects/59ee7ce06e30455586c414cf477c5968/users/1b04ec03295c41c69fad0f3c313d1b17/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.374120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-aef3b341-9f98-4a55-85c2-d7114e1ac7dd None None] MFA Rules not processed for user `5fe7dd1aa72e42b098046c3c2aa5d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.375778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aef3b341-9f98-4a55-85c2-d7114e1ac7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.381112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ee7ce06e30455586c414cf477c5968, user_id=1b04ec03295c41c69fad0f3c313d1b17, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.384480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.414107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 788/1609] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:26 2022] PUT /identity/v3/projects/59ee7ce06e30455586c414cf477c5968/users/1b04ec03295c41c69fad0f3c313d1b17/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:26.415389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.429493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.458139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 822/1610] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.460122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78b7c-e3fe-489a-b691-5387cfa0ba60 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.460674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78b7c-e3fe-489a-b691-5387cfa0ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.461120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca78b7c-e3fe-489a-b691-5387cfa0ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.487684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cca78b7c-e3fe-489a-b691-5387cfa0ba60 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.488896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cca78b7c-e3fe-489a-b691-5387cfa0ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.515529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14764a49-9b6b-4a45-bf20-44c7ce018c9f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.521473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.522500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.523064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.523631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.552315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:26.561489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:26.569484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 823/1611] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.570959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e1cb-4e51-4aaf-9976-f4fe90f36297 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.571382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e1cb-4e51-4aaf-9976-f4fe90f36297 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.571752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7e1cb-4e51-4aaf-9976-f4fe90f36297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.592670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fbc7e1cb-4e51-4aaf-9976-f4fe90f36297 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.594381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fbc7e1cb-4e51-4aaf-9976-f4fe90f36297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.606744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 824/1612] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.606744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a890091-5399-44d3-9b1f-d86376931011 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.606744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a890091-5399-44d3-9b1f-d86376931011 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.606744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a890091-5399-44d3-9b1f-d86376931011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.609039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.610829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.623785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 789/1613] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:26.624990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.650779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2a890091-5399-44d3-9b1f-d86376931011 None None] MFA Rules not processed for user `724bd78ff04b49ff8d40e72d27ca1a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.652897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2a890091-5399-44d3-9b1f-d86376931011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.736644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415e98f-409b-4892-a603-883514d3d78c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.743488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.744602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.744791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.745047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.772116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 825/1614] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.774027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.774450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.774733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.820663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:26.822376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:26.840593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 790/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:26.842706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:26.845481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] MFA Rules not processed for user `1b04ec03295c41c69fad0f3c313d1b17`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:26.849034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:26.910334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e958129-cc07-4c08-a726-0ef7c6489e8d service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:26.915024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:26.916099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:26.916716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:26.917230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:26.936588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:26.996659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 826/1616] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:26.998181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.013980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.015747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.018748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004da4a-dfe9-42f7-88ba-fd3b7546e3db None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.027530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.028214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.029899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.030504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.040027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 791/1617] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:27.041174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.062193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.063740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.065544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd394a7-6cf0-423e-bb2d-58b4dd9206b1 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.077393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.078252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.078546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.078824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.094364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 827/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:27.095283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.101038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.102537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.118629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2805cc-d5cc-42c3-83f0-583505542487 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.130471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 792/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:27.131363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.131517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.132041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.132329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.132608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.133416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.137494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.151227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65693a6-c1c7-49f6-87ec-7ddaea0c173e service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.163960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.165079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.165437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.166805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.166805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.173087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.200913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 828/1620] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:27 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:27.202167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.226807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 793/1621] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:27.230502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.294406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:27.377736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b304b-dedc-4659-88b3-b9bbf3927ae7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.390543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.392171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.392666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.393095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.393531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860efd33-aee6-4392-9b65-617227ec3bd4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.394592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.396794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.418520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.419379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.424208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.427842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.428785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.429102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 794/1622] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:27 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:27.432285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.435224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0aa30-b38f-4ff9-a946-7c3d885cfbae admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.451760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c51e3-e143-4b06-af9e-3dc652f49a26 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.459393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.467693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.467999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.468292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.471354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.473172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53b14b-f3a9-49d9-947d-3eda8b3636b6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.501387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 795/1623] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:38:27.501387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4533-3dd2-487d-945c-9cf903d199aa None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.501387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4533-3dd2-487d-945c-9cf903d199aa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.501387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4533-3dd2-487d-945c-9cf903d199aa None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.503200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 796/1624] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 23:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:27.504298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4533-3dd2-487d-945c-9cf903d199aa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.512569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 829/1625] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:27 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:27.518997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912972-5f2d-481e-8041-d10703241369 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.520549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912972-5f2d-481e-8041-d10703241369 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.520915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9912972-5f2d-481e-8041-d10703241369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.524858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4533-3dd2-487d-945c-9cf903d199aa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.530943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.539748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.540176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.540611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] PATH_INFO: `/v3/projects/18d2b4c6f56d4261b29250eadd86efa1/users/a1970bc78db149f68a9f1798fb555615/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.570419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e9912972-5f2d-481e-8041-d10703241369 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:27.570554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d2b4c6f56d4261b29250eadd86efa1, user_id=a1970bc78db149f68a9f1798fb555615, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.573736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.575325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e9912972-5f2d-481e-8041-d10703241369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:27.599056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 797/1626] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:27 2022] PUT /identity/v3/projects/18d2b4c6f56d4261b29250eadd86efa1/users/a1970bc78db149f68a9f1798fb555615/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:27.601809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.697738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:27.764633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 830/1627] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:38:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:27.766369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9912972-5f2d-481e-8041-d10703241369 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.779253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23c16d-7f4c-4096-b15e-f62524f41b24 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.795203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9912972-5f2d-481e-8041-d10703241369 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.797808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.799022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.799022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.799022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.802617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.804308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.888350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.888350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.888350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.888350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.892091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.892318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 798/1628] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:27.892318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.893400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.893400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 831/1629] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:27.893400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:27.922336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b6aa9-e873-4daa-92ff-b40946687371 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:27.929426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:27.935427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:27.936054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:27.936243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] PATH_INFO: `/v3/projects/e9101851340b4de8892b8b014a058e7f/users/5af40851004846959548fbeafc8dd3ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:27.966254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9101851340b4de8892b8b014a058e7f, user_id=5af40851004846959548fbeafc8dd3ec, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:27.970821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:27.997226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 832/1630] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:27 2022] PUT /identity/v3/projects/e9101851340b4de8892b8b014a058e7f/users/5af40851004846959548fbeafc8dd3ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:28.001401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:28.011047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5132-3dd4-4435-81d0-032b2fb164c7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:28.135493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:28.136167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.136459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.136736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.162098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985652-21d4-4f12-bcb4-06e24d05ebcc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:28.172253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:28.173057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.174120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.175102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] PATH_INFO: `/v3/projects/18d2b4c6f56d4261b29250eadd86efa1/users/a1970bc78db149f68a9f1798fb555615/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.197416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d2b4c6f56d4261b29250eadd86efa1, user_id=a1970bc78db149f68a9f1798fb555615, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:28.197416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:28.234706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 833/1631] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:27 2022] PUT /identity/v3/projects/18d2b4c6f56d4261b29250eadd86efa1/users/a1970bc78db149f68a9f1798fb555615/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:28.235730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:28.268706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:28.322786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:28.324010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1609e-fa4f-4a79-a01e-c9bd1f1636fc service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:28.344101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 799/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:28.351186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.351298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.351590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.359885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7872-1c03-4476-b1a2-45960875d412 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:28.367336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:28.368308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.368816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.369345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.370374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:28.372358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:28.392365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 834/1633] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:28.397043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:28.416498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] MFA Rules not processed for user `a1970bc78db149f68a9f1798fb555615`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:28.419263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009dd50-86f5-40df-aee6-44c6f3ffc3b2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:28.422220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:28.435738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:28.436711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.437094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.437890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] PATH_INFO: `/v3/projects/e9101851340b4de8892b8b014a058e7f/users/5af40851004846959548fbeafc8dd3ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.442576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9101851340b4de8892b8b014a058e7f, user_id=5af40851004846959548fbeafc8dd3ec, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:28.446563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409b79b-7f40-4857-844d-f810f73f6554 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:28.465958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:28.483331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 835/1634] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:28 2022] PUT /identity/v3/projects/e9101851340b4de8892b8b014a058e7f/users/5af40851004846959548fbeafc8dd3ec/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:28.494750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.495197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.495577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:28.562815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] MFA Rules not processed for user `5af40851004846959548fbeafc8dd3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:28.565861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:28.603878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 800/1635] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:28.617571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:28.834368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3df74-80e0-4f2d-b977-f283a414a2a4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:28.847250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 836/1636] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:28 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:28.954156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:28.954900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:28.955252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:28.955537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:29.128189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:29.129724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:29.157475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 801/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:29.317522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:29.331348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4526d-e2d2-4f22-ab4a-34fdaf85e970 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:29.348699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:29.349419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:29.351968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:29.352956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:29.382866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:29.386395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa72373-4a4d-40c3-825a-32d36621eb85 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:29.433917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 837/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:29.743166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:29.756647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297112-6174-416e-b41d-2df8025872e8 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:29.767897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:29.768828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:29.769322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:29.769763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:29.808394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:29.891840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:29.897376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b0983-c239-4a9a-967e-95547da65bde service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:29.925694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 802/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:30.218108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bc27-dba8-46b8-a480-9f73168df9f3 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.218457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bc27-dba8-46b8-a480-9f73168df9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.218888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bc27-dba8-46b8-a480-9f73168df9f3 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.238175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 838/1640] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 23:38:30 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:30.255546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0332d2-a81d-43d0-b5c2-5da3c547aa9a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.256739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0332d2-a81d-43d0-b5c2-5da3c547aa9a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.257502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0332d2-a81d-43d0-b5c2-5da3c547aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.324761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4b0332d2-a81d-43d0-b5c2-5da3c547aa9a None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:30.344261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4b0332d2-a81d-43d0-b5c2-5da3c547aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:30.527780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 803/1641] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 23:38:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:30.534502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917735-c9e7-4ea8-baf6-8de79765b907 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.535003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917735-c9e7-4ea8-baf6-8de79765b907 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.535190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917735-c9e7-4ea8-baf6-8de79765b907 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.536763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 839/1642] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 23:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:38:30.552808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbd46f-113b-4931-9218-65869907f51f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.553964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbd46f-113b-4931-9218-65869907f51f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.554356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbd46f-113b-4931-9218-65869907f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.592620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-70cbd46f-113b-4931-9218-65869907f51f None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:30.594639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-70cbd46f-113b-4931-9218-65869907f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:30.624016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 804/1643] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:38:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:30.649199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13917735-c9e7-4ea8-baf6-8de79765b907 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:30.673664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13917735-c9e7-4ea8-baf6-8de79765b907 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:30.682725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:30.685937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.687249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.692032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.732095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:30.736574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc462f-377c-47dc-b15e-7e77aa4420f6 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:30.746786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbd46f-113b-4931-9218-65869907f51f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:30.812158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 840/1644] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:30.972451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbd46f-113b-4931-9218-65869907f51f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:30.984743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:30.986224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:30.986740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:30.987280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] PATH_INFO: `/v3/users/1b04ec03295c41c69fad0f3c313d1b17` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:30.989585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b04ec03295c41c69fad0f3c313d1b17)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:30.991814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:31.111031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:31.115697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b04ec03295c41c69fad0f3c313d1b17'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:31.131306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b04ec03295c41c69fad0f3c313d1b17'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:31.146848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b04ec03295c41c69fad0f3c313d1b17'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:31.172895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b04ec03295c41c69fad0f3c313d1b17'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:31.174161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b04ec03295c41c69fad0f3c313d1b17'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:31.189811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 805/1645] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:30 2022] DELETE /identity/v3/users/1b04ec03295c41c69fad0f3c313d1b17 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:31.194544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:31.194838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:31.195121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:31.238873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:31.243749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:31.377939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:31.407763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 841/1646] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:31.642681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:31.644124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:31.875102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45e4e7-caf7-4352-bd41-88f1f266dc29 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:31.909019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:31.909777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:31.910062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:31.910471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:31.980406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:31.991055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:32.053310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 806/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:33.250575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:33.253073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:33.281696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d1d9-01ea-494a-bb10-c809030d0db3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:33.299965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:33.301159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:33.301828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:33.302315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] PATH_INFO: `/v3/projects/59ee7ce06e30455586c414cf477c5968` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:33.306650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ee7ce06e30455586c414cf477c5968)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:33.315314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:33.450192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ee7ce06e30455586c414cf477c5968', 'request_id': 'req-df404843-3f34-4dc8-90b4-ddf1ee139589'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.460010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ee7ce06e30455586c414cf477c5968', 'request_id': 'req-df404843-3f34-4dc8-90b4-ddf1ee139589'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.478592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ee7ce06e30455586c414cf477c5968', 'request_id': 'req-df404843-3f34-4dc8-90b4-ddf1ee139589'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.501959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] The token cache is being invalidate because project 59ee7ce06e30455586c414cf477c5968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:33.502581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.507483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-df404843-3f34-4dc8-90b4-ddf1ee139589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.509871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 842/1648] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:33 2022] DELETE /identity/v3/projects/59ee7ce06e30455586c414cf477c5968 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:33.514353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:33.528168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6e30-328d-4f2f-82f9-add31ddb603e service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:33.672108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:33.673084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:33.673455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:33.673732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] PATH_INFO: `/v3/users/a1970bc78db149f68a9f1798fb555615` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:33.675995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1970bc78db149f68a9f1798fb555615)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:33.678030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:33.732009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:33.732396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:33.732684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:33.776609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] MFA Rules not processed for user `51def40a3de745a99f67c6ef2d2bcbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:33.779101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:33.806036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1970bc78db149f68a9f1798fb555615'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.828779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1970bc78db149f68a9f1798fb555615'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.852884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1970bc78db149f68a9f1798fb555615'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.864053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:33.885433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1970bc78db149f68a9f1798fb555615'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.886436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1970bc78db149f68a9f1798fb555615'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:33.906774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 807/1649] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:33 2022] DELETE /identity/v3/users/a1970bc78db149f68a9f1798fb555615 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:33.996800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 843/1650] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:34.017007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:34.021390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:34.174321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513121f-1830-490f-b2a5-b88b6de7e363 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:34.182272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:34.182957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:34.183367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:34.183774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:34.300383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:34.303528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab8ed0-583a-4e32-98a1-5de02463fc2f service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:34.317831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 808/1651] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:34.936615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:34.938990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:34.980061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c6ed-47f8-41c3-84db-be2198cec4fe None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:35.143184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:35.144301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:35.144750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:35.145162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] PATH_INFO: `/v3/projects/18d2b4c6f56d4261b29250eadd86efa1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:35.148230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d2b4c6f56d4261b29250eadd86efa1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:35.153379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:35.176808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:35.261242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d2b4c6f56d4261b29250eadd86efa1', 'request_id': 'req-917f0ef5-a1d0-4624-8a47-b9705d754c36'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:35.268611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d2b4c6f56d4261b29250eadd86efa1', 'request_id': 'req-917f0ef5-a1d0-4624-8a47-b9705d754c36'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:35.276406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d2b4c6f56d4261b29250eadd86efa1', 'request_id': 'req-917f0ef5-a1d0-4624-8a47-b9705d754c36'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:35.300243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] The token cache is being invalidate because project 18d2b4c6f56d4261b29250eadd86efa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:35.308637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:35.310899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-917f0ef5-a1d0-4624-8a47-b9705d754c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:35.313618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 844/1652] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:34 2022] DELETE /identity/v3/projects/18d2b4c6f56d4261b29250eadd86efa1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:35.318631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:35.319121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:35.319195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:35.362705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:35.366651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:35.599386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 809/1653] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:35.607835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:35.608134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:35.608500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:35.639155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:35.649872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:35.695661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 845/1654] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:35.700975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:35.722637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447315fe-3d7e-49a7-9412-5b50476a21cb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:35.737530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:35.738231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:35.738517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:35.738797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:35.743963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:35.743963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:35.743963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:35.792383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 810/1655] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:35.793726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:35.808656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9977f-3760-43d5-8586-11a14cc351fe None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:35.822418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:35.823588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:35.823878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:35.824212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:35.826329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:35.828238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:35.880127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 846/1656] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:35 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:35.883285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:35.930520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18069d-1d8c-4dc2-9e91-8dbb38403e90 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:35.954836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:36.120342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:36.121157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:36.121547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:36.123144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:36.124920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:36.130683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:36.196349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 811/1657] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:35 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:36.197648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:36.227146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59e69d-1658-496b-95fe-4bdd221c1ddd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:36.249497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:36.249889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:36.250174 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:36.250447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:36.251187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:36.256629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:36.288290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 847/1658] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:36.292011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:36.312649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cea40-9db0-43d0-8f01-53e17f5d6f10 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:36.338106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:36.340990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:36.343275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:36.344327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:36.345983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:36.350920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab0fd4-15bf-47b8-8247-46c00fdb62d2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:36.381472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 812/1659] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:36.383305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:36.401151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c57c66-1954-4900-8a54-848ed45f9a45 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:36.411610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:36.413915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:36.414198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:36.414491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] PATH_INFO: `/v3/projects/a0fe45a349a6445187d1ae137448bb8f/users/5c53d5091b864a4e819d4f39c41bdf66/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:36.464126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fe45a349a6445187d1ae137448bb8f, user_id=5c53d5091b864a4e819d4f39c41bdf66, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:36.467443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:36.518025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 848/1660] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:36 2022] PUT /identity/v3/projects/a0fe45a349a6445187d1ae137448bb8f/users/5c53d5091b864a4e819d4f39c41bdf66/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:36.519970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:36.520342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:36.520776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:36.644728 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] MFA Rules not processed for user `5c53d5091b864a4e819d4f39c41bdf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:36.654559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:36.921011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 813/1661] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:36.925267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:37.099940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442319e1-7671-493b-bc46-4c963ad31ba3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:37.121962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:37.122816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:37.123105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:37.123387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:37.125835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:37.128172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:37.222274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 849/1662] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:36 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:37.226098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:37.256037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d607f-5d4f-4850-8206-fe8ee8220fc9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:37.452022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:37.452717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:37.453003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:37.453370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:37.454087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:37.462020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:37.527846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 814/1663] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:37 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:37.532733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:37.547345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4cf49-3aa1-4555-b1bc-396a93f84c51 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:37.561749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:37.562669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:37.563541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:37.563981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:37.564857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:37.570960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:37.597902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 850/1664] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:37.602285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:37.616011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaf675-ddf1-4173-9071-17f676be03ff admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:37.633369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:37.634339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:37.635045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:37.637177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] PATH_INFO: `/v3/projects/f79f13e5845f467ba3ad08c452515b08/users/a6b141e7c2274d0397204ba90492eff5/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:37.644182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:37.679410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f13e5845f467ba3ad08c452515b08, user_id=a6b141e7c2274d0397204ba90492eff5, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:37.687127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:37.715923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 815/1665] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:37 2022] PUT /identity/v3/projects/f79f13e5845f467ba3ad08c452515b08/users/a6b141e7c2274d0397204ba90492eff5/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:37.720719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:37.738690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7479506-66b7-4119-9d5d-c4225e0888ce admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:37.756300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:37.958196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:37.959065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:37.959395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:37.959681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:37.960778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:37.965100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0eb32-ebcf-437a-87fb-44a88f4e7706 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:38.019883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 851/1666] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:38.030849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:38.053736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96a238-2e38-40f7-b3ee-c596c1c83a74 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:38.072784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:38.074281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:38.074944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:38.076470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] PATH_INFO: `/v3/projects/f79f13e5845f467ba3ad08c452515b08/users/a6b141e7c2274d0397204ba90492eff5/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:38.082508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f13e5845f467ba3ad08c452515b08, user_id=a6b141e7c2274d0397204ba90492eff5, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:38.087038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:38.121796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 816/1667] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:38 2022] PUT /identity/v3/projects/f79f13e5845f467ba3ad08c452515b08/users/a6b141e7c2274d0397204ba90492eff5/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:38.133364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:38.134615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:38.135163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:38.182227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] MFA Rules not processed for user `a6b141e7c2274d0397204ba90492eff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:38.183997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:38.399378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 852/1668] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:38.414712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:38.417553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:38.567606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c36e-eccd-44c9-9a0f-b008917f1cc9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:38.578049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:38.579050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:38.579465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:38.579872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:38.613528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:38.616574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e4de3-8435-4fc7-a4a2-158b89865e12 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:38.655516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 817/1669] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:38.696508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:38.840780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3722-4552-4449-a8f1-1bffccd6b2b8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:38.850282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:38.851218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:38.851920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:38.851920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] PATH_INFO: `/v3/users/5c53d5091b864a4e819d4f39c41bdf66` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:38.855857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c53d5091b864a4e819d4f39c41bdf66)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:38.859902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: WARNING py.warnings [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:38.859902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: warnings.warn(msg) Jul 21 23:38:38.859902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: Jul 21 23:38:38.861336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:38.970116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:39.006096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c53d5091b864a4e819d4f39c41bdf66'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.028229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c53d5091b864a4e819d4f39c41bdf66'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.057651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c53d5091b864a4e819d4f39c41bdf66'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.061213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c53d5091b864a4e819d4f39c41bdf66'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.109180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1014dc65-fede-4113-8610-a9f8d5acbab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c53d5091b864a4e819d4f39c41bdf66'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.126261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 853/1670] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:38 2022] DELETE /identity/v3/users/5c53d5091b864a4e819d4f39c41bdf66 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:39.131182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.131520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.131801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.175529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:39.176781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.299722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.302785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.306377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.353486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] MFA Rules not processed for user `51def40a3de745a99f67c6ef2d2bcbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:39.358819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.410170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 818/1671] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:39.412314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:39.415091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.453697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b62fd3-20cd-4f0d-91a8-bf916d5d0ece None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:39.467810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:39.468557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.469125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.469672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] PATH_INFO: `/v3/users/2a672b88402a4db083626778d522ecb6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.474005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a672b88402a4db083626778d522ecb6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:39.476305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:39.542448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 854/1672] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:39.543455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:39.550096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.613120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a672b88402a4db083626778d522ecb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.625106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a672b88402a4db083626778d522ecb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.635911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a672b88402a4db083626778d522ecb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.644680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:39.662578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a672b88402a4db083626778d522ecb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.663711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-059904ff-4b98-4959-9328-7b3df80daab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a672b88402a4db083626778d522ecb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:39.674086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 819/1673] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:39 2022] DELETE /identity/v3/users/2a672b88402a4db083626778d522ecb6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:39.679315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.680357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.680805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.709699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:39.711272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.744036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cda66-76e8-4c6f-8805-2199239c4d5e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:39.811329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 820/1674] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:39.856505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:39.858085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.858730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.859014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.861481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.865988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:39.867492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:39.888483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb39e0-5616-4fff-9962-d75ea6777675 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:39.898440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:39.899102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:39.900805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:39.901820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:39.902117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:39.904518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc973a6-42fe-4970-9dcf-e37cf8beb67c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:39.936715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:39.939469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee419f08-cf07-427a-babd-6981f83b3a86 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:39.943998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 855/1675] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:39.956936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 821/1676] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:41.152713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ab9b1-04a0-4888-bb43-d5a7883dd87f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:41.153310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ab9b1-04a0-4888-bb43-d5a7883dd87f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:41.153310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ab9b1-04a0-4888-bb43-d5a7883dd87f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:41.155501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 856/1677] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 23:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:41.172445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:41.172894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:41.172894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:41.250495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:41.252152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:41.293218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 822/1678] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:38:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:41.660414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ab9b1-04a0-4888-bb43-d5a7883dd87f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:41.684019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ab9b1-04a0-4888-bb43-d5a7883dd87f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:41.712565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:41.713269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:41.716620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:41.717113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:41.732839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:41.738950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:41.750082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:41.757574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 857/1679] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:41.889687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:41.891560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:41.918863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec67b-c5c5-4ea8-84f2-65764ee85a99 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:41.927851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:41.929278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:41.930006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:41.930604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] PATH_INFO: `/v3/projects/a0fe45a349a6445187d1ae137448bb8f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:41.932934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fe45a349a6445187d1ae137448bb8f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:41.935335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: WARNING py.warnings [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 23:38:41.935335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: warnings.warn(msg) Jul 21 23:38:41.935335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: Jul 21 23:38:41.939462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:41.977368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:41.979006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.008378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e9556-acda-4ee1-a53f-5ce4e2e5ab2a service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:42.062499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fe45a349a6445187d1ae137448bb8f', 'request_id': 'req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.085453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fe45a349a6445187d1ae137448bb8f', 'request_id': 'req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.109100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fe45a349a6445187d1ae137448bb8f', 'request_id': 'req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.155231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] The token cache is being invalidate because project a0fe45a349a6445187d1ae137448bb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:42.156368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.157149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.166535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 823/1680] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:41 2022] DELETE /identity/v3/projects/a0fe45a349a6445187d1ae137448bb8f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:38:42.167577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:42.172126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.182132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:42.183634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.184054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.184483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] PATH_INFO: `/v3/users/5fe7dd1aa72e42b098046c3c2aa5d4c3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.194144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe7dd1aa72e42b098046c3c2aa5d4c3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:42.196324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:42.207108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a2a81-9fa1-41ea-b2e6-79f99ee71600 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:42.218825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:42.219854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.220242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.220675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] PATH_INFO: `/v3/users/a6b141e7c2274d0397204ba90492eff5` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.222894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b141e7c2274d0397204ba90492eff5)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:42.225625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:42.305308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:42.324379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe7dd1aa72e42b098046c3c2aa5d4c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.344171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b141e7c2274d0397204ba90492eff5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.357670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe7dd1aa72e42b098046c3c2aa5d4c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.365998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b141e7c2274d0397204ba90492eff5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.370147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe7dd1aa72e42b098046c3c2aa5d4c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.371076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe7dd1aa72e42b098046c3c2aa5d4c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.378559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b141e7c2274d0397204ba90492eff5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.402042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-11c58afb-e79c-4e5d-8bfc-4ea0a076c7e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe7dd1aa72e42b098046c3c2aa5d4c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.408628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b141e7c2274d0397204ba90492eff5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.411461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b141e7c2274d0397204ba90492eff5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.415892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 858/1681] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:41 2022] DELETE /identity/v3/users/5fe7dd1aa72e42b098046c3c2aa5d4c3 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:38:42.420669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.421165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.421876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.434480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 824/1682] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:42 2022] DELETE /identity/v3/users/a6b141e7c2274d0397204ba90492eff5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:42.461569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:42.463032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.594447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:42.596239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.646786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 859/1683] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:42.670449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:42.672499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.733178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:42.784999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c587ba-2493-4158-b268-ac7e730e8f0f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:42.798479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:42.800257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.800657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.801111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] PATH_INFO: `/v3/projects/c1883e9325554192a01b12c38acad014` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.805839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1883e9325554192a01b12c38acad014)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:42.811509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:42.830790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b7df4-914d-4ca2-902c-330d25b2e709 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:42.838094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:42.842563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.843034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.843452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.871700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:42.876148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf054a8-9d6f-454b-a25b-011cc84e75a6 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:42.896354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 860/1684] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:38:42.902926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32c79-a98e-4e10-ae25-20e38d055cf9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.903109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32c79-a98e-4e10-ae25-20e38d055cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.903923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32c79-a98e-4e10-ae25-20e38d055cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:42.930651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1883e9325554192a01b12c38acad014', 'request_id': 'req-4de2fa28-ec64-4979-a686-7d82c20abfa5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.943597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1883e9325554192a01b12c38acad014', 'request_id': 'req-4de2fa28-ec64-4979-a686-7d82c20abfa5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.959573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1883e9325554192a01b12c38acad014', 'request_id': 'req-4de2fa28-ec64-4979-a686-7d82c20abfa5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.961847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b3f32c79-a98e-4e10-ae25-20e38d055cf9 None None] MFA Rules not processed for user `b991805cfa834aab8dcab7d94d108ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:42.963445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b3f32c79-a98e-4e10-ae25-20e38d055cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:42.980816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] The token cache is being invalidate because project c1883e9325554192a01b12c38acad014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:42.983876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.986050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-4de2fa28-ec64-4979-a686-7d82c20abfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:42.993963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 825/1685] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:42 2022] DELETE /identity/v3/projects/c1883e9325554192a01b12c38acad014 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:38:42.995609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cff11-6d53-4db9-a2da-20bad442e303 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:42.998124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cff11-6d53-4db9-a2da-20bad442e303 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:42.998514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cff11-6d53-4db9-a2da-20bad442e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.042375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-782cff11-6d53-4db9-a2da-20bad442e303 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:43.043728 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-782cff11-6d53-4db9-a2da-20bad442e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.123125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 861/1686] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:43.132303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:43.133574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.133867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.134582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.187198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] MFA Rules not processed for user `b991805cfa834aab8dcab7d94d108ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:43.188348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.221462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 862/1687] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:43.239192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:43.240801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.271947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 826/1688] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:43.273676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.273971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.274853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.342791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:43.348012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.377092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 827/1689] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:43.378655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:43.406616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6235f-1049-46e4-bc4d-7bc83e521176 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:43.416157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:43.417701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.417861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.418182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.419344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:43.430424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:43.436911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:43.478881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 828/1690] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:43.483663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:43.518297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2ad2-d540-4a08-b0a4-79735fcb176c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:43.526300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:43.526994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb507-3f13-4367-8339-9d2c288fb31d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:43.527416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.528547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.529018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.540609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:43.542470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:43.550960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:43.551735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.551988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.555457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.557828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 863/1691] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:38:43.559169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:43.562580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.577586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:43.582523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df77584-477e-420a-aabe-efaaf0ba4820 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:43.583460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:43.595878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:43.596962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.597410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.597785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] PATH_INFO: `/v3/projects/f79f13e5845f467ba3ad08c452515b08` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.599294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79f13e5845f467ba3ad08c452515b08)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:43.601398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:43.648809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:43.702403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79f13e5845f467ba3ad08c452515b08', 'request_id': 'req-c3444ae6-5776-4ca0-b1f9-5a02b336813c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:43.702595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 829/1692] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:43 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:43.704493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:43.720704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79f13e5845f467ba3ad08c452515b08', 'request_id': 'req-c3444ae6-5776-4ca0-b1f9-5a02b336813c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:43.739424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79f13e5845f467ba3ad08c452515b08', 'request_id': 'req-c3444ae6-5776-4ca0-b1f9-5a02b336813c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:43.778283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] The token cache is being invalidate because project f79f13e5845f467ba3ad08c452515b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:43.779175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:43.780814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c3444ae6-5776-4ca0-b1f9-5a02b336813c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:43.790544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 864/1693] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:43 2022] DELETE /identity/v3/projects/f79f13e5845f467ba3ad08c452515b08 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:43.790544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9edd3-9976-4c0e-ba46-4b5389fc7ec4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.790544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9edd3-9976-4c0e-ba46-4b5389fc7ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.790544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9edd3-9976-4c0e-ba46-4b5389fc7ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.822702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-eba9edd3-9976-4c0e-ba46-4b5389fc7ec4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:43.824277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-eba9edd3-9976-4c0e-ba46-4b5389fc7ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:43.936934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f92bd-a598-4287-8ef6-a4f5855b71d2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:43.952128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:43.954650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:43.955037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:43.955412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:43.957167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:43.961703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.038275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 830/1694] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:43 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:44.047576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.054996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:44.067581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 865/1695] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:44.088278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.090177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.091447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.099562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b51e9-7c56-4dfe-b157-e935ef795ea4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.114917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.115730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.116122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.116503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.117681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.119445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.142668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:44.145565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:44.168444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 831/1696] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:44.169706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.171549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 866/1697] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:44.175732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.191137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088493d-b81f-4408-b648-ad381d124b7c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.204679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.205647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.205930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.206208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.206949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:44.207266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.208900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.222140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f753fa-bf38-4a0d-973b-9b573a74b20b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.239711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 867/1698] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:38:44.248241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.251107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.251909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.252689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.252689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.253928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.255647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.269803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86508026-e358-4f80-bab4-d28a7f259b88 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.284959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.285600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.285886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.286164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.286875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.288808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.294550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 832/1699] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:44.296134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.323997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddd461-81c8-4d2c-b4d8-384cbbbb13fa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.351369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.352280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.352558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.352828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] PATH_INFO: `/v3/projects/3ff965335f414d21bbe95afb849a6333/users/6326949721c947e6ad5d26fdc10ec542/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.355331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 868/1700] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:44.359860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.439900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff965335f414d21bbe95afb849a6333, user_id=6326949721c947e6ad5d26fdc10ec542, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.446554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82e50-64e9-4f79-9edb-cd20e112e95a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.481250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 833/1701] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:44 2022] PUT /identity/v3/projects/3ff965335f414d21bbe95afb849a6333/users/6326949721c947e6ad5d26fdc10ec542/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:44.500051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597bdab-978b-4954-84ba-b9b9f80e2f67 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.500340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597bdab-978b-4954-84ba-b9b9f80e2f67 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.500620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597bdab-978b-4954-84ba-b9b9f80e2f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.542861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a6e2-22e7-402d-9ea2-113555366837 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.587507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6597bdab-978b-4954-84ba-b9b9f80e2f67 None None] MFA Rules not processed for user `6326949721c947e6ad5d26fdc10ec542`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:44.588770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6597bdab-978b-4954-84ba-b9b9f80e2f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:44.592855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:44.718042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:44.725899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.726592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.726878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.727151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.733912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.736044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.824828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 869/1702] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/users => generated 305 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:44.826626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:44.849057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1a504-6ee1-44dd-8bbc-c2e82a7d1cb5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:44.880870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 834/1703] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:44.881049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:44.882435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.884709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.886793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.886910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e03a-efa7-4fb0-87ed-465ed36b5110 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.887210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e03a-efa7-4fb0-87ed-465ed36b5110 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.887493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e03a-efa7-4fb0-87ed-465ed36b5110 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.888246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:44.889778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569f111-c2c4-40f3-ae77-2e43274cbaa8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:44.889961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 835/1704] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 23:38:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:44.891116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9152a4-b627-4ff6-9306-6a4ed629b2bc None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.907694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9152a4-b627-4ff6-9306-6a4ed629b2bc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.908199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9152a4-b627-4ff6-9306-6a4ed629b2bc None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.909797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 836/1705] 10.222.0.57 () {54 vars in 961 bytes} [Thu Jul 21 23:38:44 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:38:44.915067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.915363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.915643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.929868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 870/1706] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:44.931764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:44.933750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:44.934302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:44.995075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:44.999682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:45.000113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.005631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.234359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 837/1707] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:45.235478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.273587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc9980-b590-4bac-b5e4-e84643a17912 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:45.292468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 871/1708] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Jul 21 23:38:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:45.294553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.295368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:45.297157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:45.298282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.298731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:45.299153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:45.300563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:45.305519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:45.332486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 838/1709] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:45.334050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38828724-4676-4bec-a085-b0a5dbb058a5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:45.335104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.342484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.348829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:45.349765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:45.350926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:45.351872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] PATH_INFO: `/v3/projects/b61e4573c34a4bb89e13f3731c181820` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:45.359822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61e4573c34a4bb89e13f3731c181820)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:45.362044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:45.373264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6df0-7491-4f32-bda8-7ecba5d1bf95 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:45.382547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:45.383140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:45.383426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:45.383702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:45.409083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:45.415966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:45.436752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 839/1710] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:45.449731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.503076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276349-348b-419b-be27-9a1b9a8fd249 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:45.535570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61e4573c34a4bb89e13f3731c181820', 'request_id': 'req-44113ba1-a495-4214-acf6-a06617ebdb9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:45.561385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61e4573c34a4bb89e13f3731c181820', 'request_id': 'req-44113ba1-a495-4214-acf6-a06617ebdb9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:45.593991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61e4573c34a4bb89e13f3731c181820', 'request_id': 'req-44113ba1-a495-4214-acf6-a06617ebdb9c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:45.621487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] The token cache is being invalidate because project b61e4573c34a4bb89e13f3731c181820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:45.622190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:45.623476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:45.630646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 872/1711] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:45 2022] DELETE /identity/v3/projects/b61e4573c34a4bb89e13f3731c181820 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:45.632136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.634460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.676147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:45.752577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:45.752577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:45.752921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:45.753019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:45.756113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.782192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:45.803588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:45.837889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 840/1712] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:45.839054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:45.843335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:45.874802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44113ba1-a495-4214-acf6-a06617ebdb9c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:45.918190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:45.919450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:45.919836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:45.920035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] PATH_INFO: `/v3/projects/7d9968e13eb241e19030c043d9958c7a/users/fe3097ea410d4347b4412cf5325610e2/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:45.993109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:46.001322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9968e13eb241e19030c043d9958c7a, user_id=fe3097ea410d4347b4412cf5325610e2, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:46.003997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1e59-c359-494a-92b8-44e5ab6cd463 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:46.038822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7035-60bd-4572-b84a-0f8cfb105d69 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:46.066897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 873/1713] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:45 2022] PUT /identity/v3/projects/7d9968e13eb241e19030c043d9958c7a/users/fe3097ea410d4347b4412cf5325610e2/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:46.066897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4705f-3943-4d1d-988b-60fc8b23bd17 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.066897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4705f-3943-4d1d-988b-60fc8b23bd17 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.066897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4705f-3943-4d1d-988b-60fc8b23bd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.115620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f6e4705f-3943-4d1d-988b-60fc8b23bd17 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.117761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6e4705f-3943-4d1d-988b-60fc8b23bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.235760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:46.236574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.236992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.237398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.243279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.303042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 874/1714] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:46.305154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344652b-34ab-47b6-9d42-d3487fe90fbd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.305679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344652b-34ab-47b6-9d42-d3487fe90fbd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.306157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344652b-34ab-47b6-9d42-d3487fe90fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.376569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9344652b-34ab-47b6-9d42-d3487fe90fbd None None] MFA Rules not processed for user `140a9484151c4904a25b6056f2e49520`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.378005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9344652b-34ab-47b6-9d42-d3487fe90fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.430904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:46.432676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45865c-450e-4231-b53b-7edc962cd330 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:46.444852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 841/1715] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:46.446252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab57db-057b-417f-9b98-eb54f6e2de2e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.446606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab57db-057b-417f-9b98-eb54f6e2de2e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.446970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab57db-057b-417f-9b98-eb54f6e2de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.516534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e5ab57db-057b-417f-9b98-eb54f6e2de2e None None] MFA Rules not processed for user `fe3097ea410d4347b4412cf5325610e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.518213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e5ab57db-057b-417f-9b98-eb54f6e2de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.623467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 875/1716] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:46.631540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94eae0-7268-4779-9cbe-c8bfb8ea09a8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.633360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94eae0-7268-4779-9cbe-c8bfb8ea09a8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.633783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94eae0-7268-4779-9cbe-c8bfb8ea09a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.684237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ab94eae0-7268-4779-9cbe-c8bfb8ea09a8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.689520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ab94eae0-7268-4779-9cbe-c8bfb8ea09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.718937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 876/1717] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:46.720418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.720838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.721125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.729342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 842/1718] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:46.734924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.735557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.735984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.822701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] MFA Rules not processed for user `140a9484151c4904a25b6056f2e49520`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.825588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.841176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] MFA Rules not processed for user `c44b88237c0f4ae7a31fbaaddbb2d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:46.842064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:46.846863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 843/1719] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:46.851431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:46.860732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:46.872829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5965f-fd9c-4d89-ab26-53b05723dca4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:46.881582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:46.882903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.883197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.883481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.884228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:46.884535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:46.886195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:46.899624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:46.932186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 844/1720] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:46.932186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:46.948418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570b686-d72c-4ad0-98dc-b66588065a93 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:46.962780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:46.964216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:46.964509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:46.964797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:46.965532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:46.967559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a75df-6a30-4127-8d5a-9853bc7ff0cb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.051447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 845/1721] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/projects => generated 409 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:47.052618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.052946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.053220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.079258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 877/1722] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:47.081007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.088080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:47.109488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] MFA Rules not processed for user `b991805cfa834aab8dcab7d94d108ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:47.110713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:47.147042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6a727-56b9-4e00-b540-7dffa60227ec None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.266854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 846/1723] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:47.267956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.287653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.308530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.309155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.309155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.360105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6467364-a84f-4e14-a10d-da85de0435ef None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.366540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.367373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.367669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.368021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.369020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.371179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.425720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 847/1724] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:47 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:47.425720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.528771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.531228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.547185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 878/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:47.548450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.573507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:47.584899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffc9d-8039-4068-870d-76b6078e3876 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.593613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24060b-5f45-4836-839f-ea70a95130d0 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.600095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.600879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.601331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.601715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.602627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.606343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.675535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:47.696008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 848/1726] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:47 2022] POST /identity/v3/users => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:47.698691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.727036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02a6e-7ff3-48ea-8251-899c69e1faa6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.729665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.730793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.731112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.732383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.735023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.735869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.736314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.736670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.737707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.740469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.780826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 849/1727] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:47 2022] POST /identity/v3/users => generated 286 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:47.781944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.793267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4383e2-437a-40d8-be77-959fa4f3023b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.798903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.799676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.800033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.800381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.801635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.803422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.817642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 850/1728] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:47.818775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.832740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1a6e2-28c4-48de-b36c-147967d33ba9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.838350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.839144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.839579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.839954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.841790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.843732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.864073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 851/1729] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:47.864073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.877431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f9e5-8d4a-496b-87e4-a38bddf419a5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.894644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.897504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.899073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.899990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.900504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.900794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] PATH_INFO: `/v3/projects/8dfaef5026b440f2b6be137cd9256a09/users/1db36034f7c84118b3d126511c24dfef/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.927070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 879/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:47.928424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:47.944227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfaef5026b440f2b6be137cd9256a09, user_id=1db36034f7c84118b3d126511c24dfef, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.953723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.954562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94e8dc-22c7-4b9f-8b0a-633d20ec2a23 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:47.967087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:47.970733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:47.971236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:47.972241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:47.973138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:47.976502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:47.978830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 852/1731] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:47 2022] PUT /identity/v3/projects/8dfaef5026b440f2b6be137cd9256a09/users/1db36034f7c84118b3d126511c24dfef/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:47.983293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:48.031493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 880/1732] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:48.037037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:48.076468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db924-430b-41a3-93f1-c1b55784795b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:48.163383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83437-1838-4473-95de-6a12232bd2c6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:48.171546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:48.172522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.173011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.174102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.176325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:48.178537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:48.198972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 853/1733] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:48.200539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:48.215517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e6ef-69b9-4960-8765-3bb56b2a3eeb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:48.223233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:48.224136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.224413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.224685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] PATH_INFO: `/v3/projects/8dfaef5026b440f2b6be137cd9256a09/users/1db36034f7c84118b3d126511c24dfef/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.229017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dfaef5026b440f2b6be137cd9256a09, user_id=1db36034f7c84118b3d126511c24dfef, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:48.232591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d60a3-9203-4045-80ff-ea79a7da1a0e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:48.250288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 854/1734] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:48 2022] PUT /identity/v3/projects/8dfaef5026b440f2b6be137cd9256a09/users/1db36034f7c84118b3d126511c24dfef/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:48.276961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.277462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.277871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.298631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:48.300015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.300582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.301042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] PATH_INFO: `/v3/projects/b5dcbecabd5246ef8ceafbc71c8f7bfd/users/e9800d40c8d947e49992faa7613084b8/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.348853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dcbecabd5246ef8ceafbc71c8f7bfd, user_id=e9800d40c8d947e49992faa7613084b8, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:48.350686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] MFA Rules not processed for user `1db36034f7c84118b3d126511c24dfef`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:48.352151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1607a-b3e4-4572-9efc-fdd9ef56665e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:48.355707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:48.391584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 881/1735] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:48 2022] PUT /identity/v3/projects/b5dcbecabd5246ef8ceafbc71c8f7bfd/users/e9800d40c8d947e49992faa7613084b8/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:38:48.403679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.404135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.404360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.465508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] MFA Rules not processed for user `e9800d40c8d947e49992faa7613084b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:48.466966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:48.554197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:48.590058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:48.621673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 855/1736] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:48.639611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:48.641297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 882/1737] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:48.645430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:48.657027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:48.783935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8880631-51ca-45cb-a903-1eb443da9fb1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:48.797730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:48.798673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:48.799307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:48.799720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:48.800559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:48.806099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:48.875829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e5ba-9842-4f05-bba6-683d2d4f9ea5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:48.903795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 883/1738] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:48.904980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.052011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.052729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.053010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.057415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.114590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63b37-eded-459f-b576-a182e9f72e9e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.132631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.134252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.136235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.139419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.144224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.150132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.210417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 884/1739] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:48 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:49.212670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.235872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3f9a-6467-4489-95fa-7daa44a6d4b5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.251740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.253327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.255602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.256086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.257293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.261412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.289110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 885/1740] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:38:49.290141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.291784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.293465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.336521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae415bb6-5cd7-437d-b685-a28904b21981 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.361298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 856/1741] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:49.377444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.383261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.386289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.387852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] PATH_INFO: `/v3/projects/f576972ef8d34f5aa45af6e6e7239013/users/11b3527aa2ec45a0a0105c8307df171e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.433256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f576972ef8d34f5aa45af6e6e7239013, user_id=11b3527aa2ec45a0a0105c8307df171e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.439374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0b1de-a484-4b26-895d-2858281b666f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.486057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 886/1742] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:49 2022] PUT /identity/v3/projects/f576972ef8d34f5aa45af6e6e7239013/users/11b3527aa2ec45a0a0105c8307df171e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:49.490122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.511865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb887f-4321-4d88-befd-84e097c00957 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.669102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:49.679463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.680620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.681470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.689811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.694951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.699705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.706627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181475-f6bc-416d-988f-f07610b9b14e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.706927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181475-f6bc-416d-988f-f07610b9b14e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.707242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181475-f6bc-416d-988f-f07610b9b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.737490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 857/1743] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:49.739558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.756765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fff3b1-042c-4f7c-a151-d054c1a19183 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.783809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.785506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.786122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.786457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] PATH_INFO: `/v3/projects/f576972ef8d34f5aa45af6e6e7239013/users/11b3527aa2ec45a0a0105c8307df171e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:49.789410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f576972ef8d34f5aa45af6e6e7239013, user_id=11b3527aa2ec45a0a0105c8307df171e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:49.793062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:49.808392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 858/1744] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:49 2022] PUT /identity/v3/projects/f576972ef8d34f5aa45af6e6e7239013/users/11b3527aa2ec45a0a0105c8307df171e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:49.811371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:49.855961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:49.890269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-16181475-f6bc-416d-988f-f07610b9b14e None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:49.891566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-16181475-f6bc-416d-988f-f07610b9b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:49.955528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab422b-5a76-4771-9ae9-5de10e4b72d6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:49.962890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:49.964020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:49.964498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:49.964909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:50.072316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:50.074071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:50.101518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 887/1745] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:50.103421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:50.103854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:50.104280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:50.115056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 859/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:50.206884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] MFA Rules not processed for user `11b3527aa2ec45a0a0105c8307df171e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:50.208168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:50.422493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 888/1747] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:50.435236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:50.442104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:50.780374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16943b55-44fc-4cef-8f7b-f0ff77f3fe7f service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:50.804232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:50.805359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:50.805909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:50.806403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:50.830082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:50.832353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:50.863907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 860/1748] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:38:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:38:51.001746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:51.014299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002b1ca-5e46-43aa-9d67-d3c2b698f9ef None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:51.053223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:51.058613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:51.064182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:51.066586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:51.171517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:51.179922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:51.245129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 889/1749] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:51.574241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:51.583190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:51.596437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34109c5-b8de-43e2-a47d-49277a7b904c service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:51.621495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:51.630144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:51.630611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:51.630994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:51.803655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:51.803655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:51.957062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:51.960411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861bd19-fbc7-4efe-b431-53da37e1661f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:52.027595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 861/1750] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:52.138203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f092e6c-3592-49c1-b2d7-6c891d6807df service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:52.165860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:52.170644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:52.174929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:52.175948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] PATH_INFO: `/v3/users/6326949721c947e6ad5d26fdc10ec542` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:52.180558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6326949721c947e6ad5d26fdc10ec542)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:52.193884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:52.237561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:52.426799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6326949721c947e6ad5d26fdc10ec542'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:52.489101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6326949721c947e6ad5d26fdc10ec542'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:52.537347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6326949721c947e6ad5d26fdc10ec542'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:52.540474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6326949721c947e6ad5d26fdc10ec542'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:52.600004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6326949721c947e6ad5d26fdc10ec542'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:52.633561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 890/1751] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:51 2022] DELETE /identity/v3/users/6326949721c947e6ad5d26fdc10ec542 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:52.638838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:52.639294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:52.639883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:52.706844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:52.711512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:52.912445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 862/1752] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:52.979673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:52.983775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:53.215993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135b6db-11af-4290-9338-fef91f097a69 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:53.231469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:53.232168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:53.232451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:53.232728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:53.296259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:53.297767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d80bfd-915d-4f8c-a08d-eabda8dd22c4 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:53.338237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 891/1753] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:54.518933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:54.521090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:54.568270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f650f8-bb75-4497-97a2-a1e80a1d91f0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:54.622601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:54.624021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:54.624475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:54.625628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] PATH_INFO: `/v3/users/724bd78ff04b49ff8d40e72d27ca1a05` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:54.633075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] RBAC: Authorizing `identity:delete_user(user_id=724bd78ff04b49ff8d40e72d27ca1a05)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:54.643362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:54.776909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724bd78ff04b49ff8d40e72d27ca1a05'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:54.805621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724bd78ff04b49ff8d40e72d27ca1a05'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:54.829079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724bd78ff04b49ff8d40e72d27ca1a05'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:54.844589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:54.845170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:54.845170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:54.898190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724bd78ff04b49ff8d40e72d27ca1a05'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:54.899727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] MFA Rules not processed for user `c44b88237c0f4ae7a31fbaaddbb2d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:54.899871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-25547fe4-2318-4ec2-8503-1bb275d7ceef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724bd78ff04b49ff8d40e72d27ca1a05'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:54.901385 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:54.932302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 863/1754] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:54 2022] DELETE /identity/v3/users/724bd78ff04b49ff8d40e72d27ca1a05 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:54.934595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:54.935009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:54.935334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.010680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 892/1755] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:55.020300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:55.023298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:55.053913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:55.149748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 864/1756] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:55.168007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:55.170157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:55.190976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cd1a6-9631-4f9c-869c-7264b216acb7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:55.295207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:55.327181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:55.328879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:55.329380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:55.329894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.343325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:55.345064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7af53b-b926-4242-a55c-d71a7cc13e32 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:55.360934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 893/1757] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:55.428489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:55.430249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:55.487507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f65aa6-c0fd-4189-bf66-5bf846c4d158 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:55.497513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:55.503376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:55.504505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:55.505549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] PATH_INFO: `/v3/projects/3ff965335f414d21bbe95afb849a6333` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.508527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff965335f414d21bbe95afb849a6333)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:55.511667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:55.609482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff965335f414d21bbe95afb849a6333', 'request_id': 'req-84bf00ce-8cb9-4450-89da-a012383a2d0f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.636339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff965335f414d21bbe95afb849a6333', 'request_id': 'req-84bf00ce-8cb9-4450-89da-a012383a2d0f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.660525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff965335f414d21bbe95afb849a6333', 'request_id': 'req-84bf00ce-8cb9-4450-89da-a012383a2d0f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.690549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] The token cache is being invalidate because project 3ff965335f414d21bbe95afb849a6333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:55.694370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.695823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.701098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 865/1758] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:55 2022] DELETE /identity/v3/projects/3ff965335f414d21bbe95afb849a6333 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:38:55.706568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d65b-fe9a-434e-969f-c61ac0254281 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:55.707352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d65b-fe9a-434e-969f-c61ac0254281 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:55.708671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8d65b-fe9a-434e-969f-c61ac0254281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.721045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:55.724942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:55.754230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-c6d8d65b-fe9a-434e-969f-c61ac0254281 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:55.757342 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c6d8d65b-fe9a-434e-969f-c61ac0254281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:55.820017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf00ce-8cb9-4450-89da-a012383a2d0f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:55.826113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:55.827117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:55.827460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:55.827747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] PATH_INFO: `/v3/projects/8e93cf25ed2a450795460769e656e674` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.830137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e93cf25ed2a450795460769e656e674)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:55.833925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:55.870926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 894/1759] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:55.897741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:55.898044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:55.898520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:55.942689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:55.963673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e93cf25ed2a450795460769e656e674', 'request_id': 'req-421da881-e046-4b54-bdba-fdbf95e099f5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:55.988648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e93cf25ed2a450795460769e656e674', 'request_id': 'req-421da881-e046-4b54-bdba-fdbf95e099f5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.005528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e93cf25ed2a450795460769e656e674', 'request_id': 'req-421da881-e046-4b54-bdba-fdbf95e099f5'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.015214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:56.019825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:56.041511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] The token cache is being invalidate because project 8e93cf25ed2a450795460769e656e674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:56.043242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.046380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.051096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 866/1760] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:55 2022] DELETE /identity/v3/projects/8e93cf25ed2a450795460769e656e674 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:56.057221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:56.060547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:56.163589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 895/1761] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:56.164441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:56.189956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d77fc-69a5-4bd4-8645-fab148d9dd6f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:56.203205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:56.204092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:56.204387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:56.204670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:56.205451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:56.205760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:56.211745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:56.256275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421da881-e046-4b54-bdba-fdbf95e099f5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:56.276121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:56.277373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:56.277817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:56.278209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] PATH_INFO: `/v3/users/5af40851004846959548fbeafc8dd3ec` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:56.280008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af40851004846959548fbeafc8dd3ec)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:56.280634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 896/1762] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:56.282457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:56.286205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:56.310053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8ea5e-a139-4e51-a1fc-eae9d09fe3c3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:56.323337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:56.324303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:56.325442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:56.328043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:56.330235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:56.332378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:56.413909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 897/1763] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:56 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:56.420046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:56.438487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af40851004846959548fbeafc8dd3ec'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.473435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af40851004846959548fbeafc8dd3ec'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.524195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af40851004846959548fbeafc8dd3ec'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.613922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af40851004846959548fbeafc8dd3ec'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.620727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af40851004846959548fbeafc8dd3ec'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:56.655045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 867/1764] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:56 2022] DELETE /identity/v3/users/5af40851004846959548fbeafc8dd3ec => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:56.678766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:56.780694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0dbba-4166-4154-b206-f0f34d3c5745 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:57.075537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:57.080410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.080708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.080994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.081764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:57.107220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:57.190099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:57.192458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:57.195652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 898/1765] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:56 2022] POST /identity/v3/users => generated 287 bytes in 769 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:57.233640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a500c5-0f38-4043-b287-ec4b97179dfd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:57.261974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:57.263014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.263202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.264264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.265504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:57.267271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:57.304215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:57.317334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 868/1766] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:57.318963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c7653-a8f5-4d9c-a1d0-035b65673b66 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:57.341539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:57.342476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.345587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.346052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.348732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:57.355131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86709d-6f9e-451f-a4d5-231cc3186a5f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:57.399300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 899/1767] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:38:57.403680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:57.426264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e173-2aae-4ffc-b7dd-9fa0b7148979 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:57.438045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:57.441924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.443372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.443991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] PATH_INFO: `/v3/projects/c3298399b49e4cef9fff71b91c0ee4fa/users/4446ea3c59b54272aaa662ccd7d1d971/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.491489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3298399b49e4cef9fff71b91c0ee4fa, user_id=4446ea3c59b54272aaa662ccd7d1d971, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:57.503909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d78a16-a8a9-44df-aadb-b6a0fe8f8d70 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:57.507202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.507983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.507983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.583897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 869/1768] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:57 2022] PUT /identity/v3/projects/c3298399b49e4cef9fff71b91c0ee4fa/users/4446ea3c59b54272aaa662ccd7d1d971/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:57.595164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:57.595460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:57.595737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:57.598534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:57.598926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:57.714909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:57.725100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] MFA Rules not processed for user `4446ea3c59b54272aaa662ccd7d1d971`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:57.733114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:57.845834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 900/1769] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 21 23:38:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:57.977634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 870/1770] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:58.224001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:58.226419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:58.412218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09c5f8-29e6-4666-b860-e01b259e296f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:58.442676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:58.461336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:58.465842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:58.466379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:58.492370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:58.498331 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9bf3-4099-4260-840e-4980ca28219e service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:58.545825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 901/1771] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:58.578191 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:58.585955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:58.753246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd03f6a-1d96-44dc-9cc3-9ba4f38721e9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:58.765155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:58.766069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:58.766352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:58.766631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] PATH_INFO: `/v3/projects/e9101851340b4de8892b8b014a058e7f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:58.770079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9101851340b4de8892b8b014a058e7f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:58.772945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:58.933025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9101851340b4de8892b8b014a058e7f', 'request_id': 'req-e1bcb684-8f17-4d1d-8739-cdb544d41498'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:58.950762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9101851340b4de8892b8b014a058e7f', 'request_id': 'req-e1bcb684-8f17-4d1d-8739-cdb544d41498'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:58.971133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9101851340b4de8892b8b014a058e7f', 'request_id': 'req-e1bcb684-8f17-4d1d-8739-cdb544d41498'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.000940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] The token cache is being invalidate because project e9101851340b4de8892b8b014a058e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:38:59.000940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.008140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.008818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 871/1772] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:38:58 2022] DELETE /identity/v3/projects/e9101851340b4de8892b8b014a058e7f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:59.016166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844c838-c2c5-4160-bc32-4171a1e1b7c0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.016457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844c838-c2c5-4160-bc32-4171a1e1b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.016735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844c838-c2c5-4160-bc32-4171a1e1b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.056560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8844c838-c2c5-4160-bc32-4171a1e1b7c0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:59.057931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8844c838-c2c5-4160-bc32-4171a1e1b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.070143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:59.085681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.087628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.160901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:59.249617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcb684-8f17-4d1d-8739-cdb544d41498 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.259689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 902/1773] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:59.261269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.261826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.266040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.267957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.269856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.270356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.270773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] PATH_INFO: `/v3/users/4446ea3c59b54272aaa662ccd7d1d971` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.272089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4446ea3c59b54272aaa662ccd7d1d971)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.274184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.305810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:59.307241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.322309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 903/1774] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:38:59.327935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.351367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf7e7-98e2-4533-b4ac-6004ea2cb4af None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.359921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.361065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.362387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.363719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.365302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:38:59.365832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.368762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.379269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4446ea3c59b54272aaa662ccd7d1d971'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.399629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4446ea3c59b54272aaa662ccd7d1d971'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.403592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 904/1775] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:38:59.409069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.414276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4446ea3c59b54272aaa662ccd7d1d971'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.429929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5277d6-b480-4e30-ae28-0be7538fec4d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.436882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.438384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.438573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.439007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.439931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.442423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.446182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4446ea3c59b54272aaa662ccd7d1d971'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.447241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-fd740acb-3962-4f88-9000-28b52f8c2968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4446ea3c59b54272aaa662ccd7d1d971'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:38:59.462616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 872/1776] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:38:59 2022] DELETE /identity/v3/users/4446ea3c59b54272aaa662ccd7d1d971 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:59.467954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.468254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.468564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.482831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 905/1777] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:38:59.484030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.485883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.501689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:38:59.502928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.579168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175809f1-bde3-438e-a55a-cd32a7e9243f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.585118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.585920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.586202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.586477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.587543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.591110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.596269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 873/1778] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:38:59.610000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.611626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:38:59.629807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 906/1779] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:38:59.639586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.669543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7805c2-57c1-443b-9d5e-935012988873 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.682428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.683274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.685856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.686143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.686901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.693016 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.721167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 907/1780] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:59.724092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.746253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0713009-0dac-41e6-b113-e697fa818683 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.758613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af206b81-6e18-4c55-8339-d02e76585150 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.765933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.766602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.766888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.767161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.775660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.780545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.782138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.782440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.783241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.783458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:38:59.790635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2921b0c-218c-4262-89ee-34c868267bf1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.795065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.796551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.810811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 874/1781] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:38:59.820254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 908/1782] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:38:59.825908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:38:59.836525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f841e8-7897-44f4-aa2a-941948d61d5d service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:38:59.844262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:38:59.845158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.845503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.845775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] PATH_INFO: `/v3/projects/2a9d6864ab264712a39f20bab0239e18/users/6226d813c60e48468f162d5c32f74531/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:38:59.916217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9d6864ab264712a39f20bab0239e18, user_id=6226d813c60e48468f162d5c32f74531, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:38:59.926439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:38:59.964629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 875/1783] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:38:59 2022] PUT /identity/v3/projects/2a9d6864ab264712a39f20bab0239e18/users/6226d813c60e48468f162d5c32f74531/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:38:59.975617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:38:59.975918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:38:59.976202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.008481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] MFA Rules not processed for user `6226d813c60e48468f162d5c32f74531`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:00.010398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:00.055375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:00.143551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 909/1784] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:38:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:00.147691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.243532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c17be6-740b-4622-b9d2-b6346bdb9bad admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.250685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.251689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.251975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.252256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.253277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.255210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.288369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 876/1785] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:00 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:00.292368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.306074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f97c9-4960-4650-b83e-760ab055a58b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.378399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.379025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.380280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.380754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.381551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.389848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.414109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 910/1786] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:00 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:00.419400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.431542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.433655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:00.437233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855ba8-e5f8-485f-8dd3-7316d7764314 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.454520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.455220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.455506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.455783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.457049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.458862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.469175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7eae82-2a74-4e34-bc70-2e618a51cc3e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.479831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 877/1787] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:00.480485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.482816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.482935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.483102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.483379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] PATH_INFO: `/v3/projects/c3298399b49e4cef9fff71b91c0ee4fa` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.485285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3298399b49e4cef9fff71b91c0ee4fa)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.487754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.509481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883d123-0168-4c56-80e2-b6d2a2f21bc0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.519798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.520983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.521295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.521572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] PATH_INFO: `/v3/projects/9e3030108712429f90eb6b49d9dc5d1f/users/44834b64a0d14c5aa34371a0e7d51c90/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.553136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3030108712429f90eb6b49d9dc5d1f, user_id=44834b64a0d14c5aa34371a0e7d51c90, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.564183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.595359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3298399b49e4cef9fff71b91c0ee4fa', 'request_id': 'req-9f914b55-7d7e-425b-8f52-4811befb58cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:00.615151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3298399b49e4cef9fff71b91c0ee4fa', 'request_id': 'req-9f914b55-7d7e-425b-8f52-4811befb58cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:00.620463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 878/1788] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:00 2022] PUT /identity/v3/projects/9e3030108712429f90eb6b49d9dc5d1f/users/44834b64a0d14c5aa34371a0e7d51c90/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:00.625211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.642738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3298399b49e4cef9fff71b91c0ee4fa', 'request_id': 'req-9f914b55-7d7e-425b-8f52-4811befb58cb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:00.667953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] The token cache is being invalidate because project c3298399b49e4cef9fff71b91c0ee4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:00.668352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:00.670755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f914b55-7d7e-425b-8f52-4811befb58cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:00.678014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 911/1789] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:00 2022] DELETE /identity/v3/projects/c3298399b49e4cef9fff71b91c0ee4fa => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:00.679813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8292f-9653-4f47-9834-14c4eba11855 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.680579 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8292f-9653-4f47-9834-14c4eba11855 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.681315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8292f-9653-4f47-9834-14c4eba11855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.730039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-29c8292f-9653-4f47-9834-14c4eba11855 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:00.732056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-29c8292f-9653-4f47-9834-14c4eba11855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:00.789748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:00.836576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e958f-89f8-4256-962e-3b4af0c0942e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.852284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:00.853365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.854173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.854469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.860815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:00.865669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:00.915999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 879/1790] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:00.926466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:00.931428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 912/1791] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:00.936328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:00.948043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:00.950757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:00.950757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:00.984404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e46cf-930e-4490-ab99-e5177a7d9a5b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:00.998130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.001982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.002290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.002537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] PATH_INFO: `/v3/projects/9e3030108712429f90eb6b49d9dc5d1f/users/44834b64a0d14c5aa34371a0e7d51c90/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.010087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3030108712429f90eb6b49d9dc5d1f, user_id=44834b64a0d14c5aa34371a0e7d51c90, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.012992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.036628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:01.042104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:01.067809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 880/1792] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:00 2022] PUT /identity/v3/projects/9e3030108712429f90eb6b49d9dc5d1f/users/44834b64a0d14c5aa34371a0e7d51c90/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:01.068714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.085931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:01.131568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:01.360439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0812452-b4e5-450c-b550-955191b30f6b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.374437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.375912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.376173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 913/1793] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:01.378072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.378468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.379472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.384395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:01.426536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9efa2-c2e7-4f74-8b55-d249ff0a3335 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.436316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.441444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.447297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.447996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.449661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.450599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.469751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 881/1794] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:01.471061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.473790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.475263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:01.483819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.508556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 914/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:01.509457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.513879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0577f7-a4af-4b08-bba0-c37bad158493 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.534609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc13e-69ad-4057-a085-2401d492472b service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.542728 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.544434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.549592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.549702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.550324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.550607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.550881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.551205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.576716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.577112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.578989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.579426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51847677-be59-4a1b-84c0-7b2a2bdf2127 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.595424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 882/1796] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:01.597788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.598418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.599071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.620408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 915/1797] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:01.624361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.666230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00404976-adf1-4953-9622-36511d4a4371 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.673511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.674261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.674614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.674962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.676008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:01.676405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.678129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.695737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] MFA Rules not processed for user `44834b64a0d14c5aa34371a0e7d51c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:01.701283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:01.743399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 916/1798] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:01.751445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.783820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dadde63-9941-44a0-8f6b-cbb6005f2f8e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:01.813542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:01.813542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:01.813542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:01.813542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:01.814111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:01.817775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:01.898688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 917/1799] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:01 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:01.904432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.923122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 883/1800] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:01.932772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:01.937040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:02.089817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fa269-696b-4c81-a9cf-3efc02ec131f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:02.147813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dfe7c-c7e6-4abb-8bbc-9bbe4675cd7e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:02.165977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:02.167009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.167350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.167624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.168440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:02.182360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:02.186460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:02.262311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:02.262987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.263371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.263663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.267511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 918/1801] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:01 2022] POST /identity/v3/users => generated 291 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:02.269844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:02.316030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736fd34-e4f2-4752-a749-07318b50c2a4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:02.325959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:02.326881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.327311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.327753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.329868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:02.347185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:02.352137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:02.397291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 919/1802] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:02.405802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:02.442075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca9509-803e-42f6-a9cd-7ef824961c11 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:02.454066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:02.455167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.455811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.456102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.460400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:02.462505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:02.516757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:02.520890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc8114-d2df-48f8-a5fe-988411f6c27f service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:02.528322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 920/1803] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:02.529853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:02.554837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 884/1804] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:02.557408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b6ce-1d6e-43e2-92e1-325ca5ef2e87 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:02.565601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:02.566959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.567732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.568214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] PATH_INFO: `/v3/projects/50cbf1b51fe64fa691b401b6b3cfa1ce/users/aecf30ff2a85433baaa09e29e86abd25/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.642685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cbf1b51fe64fa691b401b6b3cfa1ce, user_id=aecf30ff2a85433baaa09e29e86abd25, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:02.648244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:02.715621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:02.716098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:02.722236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:02.751104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 921/1805] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:02 2022] PUT /identity/v3/projects/50cbf1b51fe64fa691b401b6b3cfa1ce/users/aecf30ff2a85433baaa09e29e86abd25/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:02.783538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] MFA Rules not processed for user `aecf30ff2a85433baaa09e29e86abd25`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:02.785295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:02.964175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.043270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 885/1806] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:03.048253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.209617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372090d8-46a7-4b03-977a-363f7a767d8b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.241987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.244870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.247339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.247915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.257300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:03.336443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe71562-4013-4b13-8bb2-6205ddbc4e74 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.354021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.354843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.357877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.360448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.363242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.369400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.422338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:03.447719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 886/1807] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:03 2022] POST /identity/v3/projects => generated 379 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:03.448884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.451408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:03.464420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.471507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.507058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 922/1808] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:03.507922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.531000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e8fb-5749-4bce-8e73-be6550d87a05 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.646100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b68e9-e0a6-43dc-8e3e-086124e102cb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.659459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.661267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.661267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.662343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] PATH_INFO: `/v3/users/fe3097ea410d4347b4412cf5325610e2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.664784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3097ea410d4347b4412cf5325610e2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.669607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.673860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.685434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.685434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.685434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.685434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.687989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.728498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 923/1809] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:03 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:03.732360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.759874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:03.769387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc096-d710-4c3b-8c21-4dca726191be admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.784828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.785747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.789425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.789744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.790521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.794233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.820681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 924/1810] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:03.825853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:03.854818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cecea-dfde-4ecb-8ada-f6e8a963ed0b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:03.868905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:03.870388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:03.870876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:03.871998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] PATH_INFO: `/v3/projects/62783e34483440b6a43bafb7a2819992/users/f4270be91f5f430e9797ea91be755516/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:03.920704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3097ea410d4347b4412cf5325610e2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:03.920913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62783e34483440b6a43bafb7a2819992, user_id=f4270be91f5f430e9797ea91be755516, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:03.931944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:03.947658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3097ea410d4347b4412cf5325610e2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:03.969667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3097ea410d4347b4412cf5325610e2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:03.973819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 925/1811] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:03 2022] PUT /identity/v3/projects/62783e34483440b6a43bafb7a2819992/users/f4270be91f5f430e9797ea91be755516/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:03.984020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:04.022880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3097ea410d4347b4412cf5325610e2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:04.026279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-487672c6-0b44-4efb-871f-1ca0591ee756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3097ea410d4347b4412cf5325610e2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:04.059478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 887/1812] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:03 2022] DELETE /identity/v3/users/fe3097ea410d4347b4412cf5325610e2 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:04.059478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa4aad-9b61-4dec-8350-9d73832617b0 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.059478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa4aad-9b61-4dec-8350-9d73832617b0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.059478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa4aad-9b61-4dec-8350-9d73832617b0 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.061046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 888/1813] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:39:04.063716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6452bc-ea4e-4947-b7e0-79cd381bb894 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.065450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6452bc-ea4e-4947-b7e0-79cd381bb894 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.065771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6452bc-ea4e-4947-b7e0-79cd381bb894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.125411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3a6452bc-ea4e-4947-b7e0-79cd381bb894 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:04.126653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3a6452bc-ea4e-4947-b7e0-79cd381bb894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.146179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed251a-5972-44de-b884-e6d659fc7676 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:04.265313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 889/1814] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:04.279018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.279349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.279587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.315188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:04.318380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.351293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:04.358278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:04.359864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.360276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.360641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.380901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:04.384698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:04.425545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 926/1815] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:04.445670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:04.449565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.506006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 890/1816] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:39:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:04.506696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:04.508003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.537818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694b6f5-cf05-408f-b255-e1a0779a792f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:04.552447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f38629-b579-4ba0-9f24-5d466acccb4e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:04.557480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:04.558393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.558613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:04.559296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.559537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] PATH_INFO: `/v3/projects/62783e34483440b6a43bafb7a2819992/users/f4270be91f5f430e9797ea91be755516/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.560235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.560729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.561276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.570746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62783e34483440b6a43bafb7a2819992, user_id=f4270be91f5f430e9797ea91be755516, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:04.573506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb3041a-6fac-4ccd-bfc4-09a265665e2d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:04.585245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:04.588242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:04.612775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 927/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:04.614222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:04.615303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 891/1818] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:04 2022] PUT /identity/v3/projects/62783e34483440b6a43bafb7a2819992/users/f4270be91f5f430e9797ea91be755516/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:04.629434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.629768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.630427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.631096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.665653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257daea-680b-46eb-85fc-f7691c2ad209 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:04.711394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:04.758529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] MFA Rules not processed for user `f4270be91f5f430e9797ea91be755516`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:04.759799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:04.883150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:04.888336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:04.892726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:04.893220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:04.924255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:04.927565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:04.975285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 928/1819] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:05.031875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 892/1820] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:05.221934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:05.226185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:05.392730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba4c51-0a92-42c3-bf67-316f6c86b39e service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:05.411741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:05.422264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:05.423373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:05.424921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:05.448375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:05.451340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:05.482969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 929/1821] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:05.691183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:05.693646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:05.729061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798adf4-3201-431f-8c15-bf0a6d3e7f40 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:05.734082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:05.734943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:05.735401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:05.735821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:05.737894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:05.898460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:05.899897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:05.937390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 893/1822] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:06.448443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:06.450191 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:06.664876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d489a99-f2ec-406f-b956-eb6366d8119c service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:06.696094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:06.704761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:06.705963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:06.706731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] PATH_INFO: `/v3/projects/7d9968e13eb241e19030c043d9958c7a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:06.708863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9968e13eb241e19030c043d9958c7a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:06.712856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:06.865749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:06.878406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9968e13eb241e19030c043d9958c7a', 'request_id': 'req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:06.895595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9968e13eb241e19030c043d9958c7a', 'request_id': 'req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:06.921699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9968e13eb241e19030c043d9958c7a', 'request_id': 'req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:06.951697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] The token cache is being invalidate because project 7d9968e13eb241e19030c043d9958c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:06.953339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:06.954200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41093fb8-c4dd-4ca3-b942-0726e0b4e7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:06.961855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:06.963307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 930/1823] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:06 2022] DELETE /identity/v3/projects/7d9968e13eb241e19030c043d9958c7a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:06.991252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d451cf-7c38-43e5-a6f4-669d45964090 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:07.058225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:07.236878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:07.254165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:07.255567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:07.263884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] PATH_INFO: `/v3/users/1db36034f7c84118b3d126511c24dfef` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:07.271974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db36034f7c84118b3d126511c24dfef)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:07.284752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:07.452221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bb17-9c19-47e1-93c1-b1ca0dc6e725 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:07.453132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bb17-9c19-47e1-93c1-b1ca0dc6e725 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:07.453847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bb17-9c19-47e1-93c1-b1ca0dc6e725 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:07.456581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 931/1824] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:39:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:39:07.504006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db36034f7c84118b3d126511c24dfef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:07.533515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db36034f7c84118b3d126511c24dfef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:07.558992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:07.559897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:07.560383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:07.574263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db36034f7c84118b3d126511c24dfef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:07.620558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:07.626898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:07.630922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db36034f7c84118b3d126511c24dfef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:07.635031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db36034f7c84118b3d126511c24dfef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:07.673200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 894/1825] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:06 2022] DELETE /identity/v3/users/1db36034f7c84118b3d126511c24dfef => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:07.856097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 932/1826] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:39:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:08.350060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:08.352111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:08.511537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206bfb1-afc5-4a88-805d-cc0713624c77 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:08.520791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:08.521845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:08.522273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:08.522839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:08.534645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:08.536842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3741a-bc75-4dad-af94-9d77e1ffaaab service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:08.552799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 895/1827] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:09.409831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.412088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:09.430407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a9ed6-28af-4244-afb5-c3807a96e8b3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.510689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.512759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.513043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.513345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] PATH_INFO: `/v3/projects/8dfaef5026b440f2b6be137cd9256a09` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.514778 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dfaef5026b440f2b6be137cd9256a09)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.516913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.566711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dfaef5026b440f2b6be137cd9256a09', 'request_id': 'req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:09.572172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dfaef5026b440f2b6be137cd9256a09', 'request_id': 'req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:09.578939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dfaef5026b440f2b6be137cd9256a09', 'request_id': 'req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:09.582593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:09.593424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] The token cache is being invalidate because project 8dfaef5026b440f2b6be137cd9256a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:09.593946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:09.594712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a8d6e437-20e2-4e79-aa69-c33f21cd2d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:09.596581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 933/1828] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:09 2022] DELETE /identity/v3/projects/8dfaef5026b440f2b6be137cd9256a09 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:09.601476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.601973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.602116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.619744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:09.620959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:09.643886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:09.687504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 896/1829] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:09.696259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.696549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.696826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.715871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:09.717075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:09.725926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 934/1830] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:09.728959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.740113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655df6e-5fe9-4f45-839b-815081bc1f0d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.745956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.747311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.747700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.748112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.749386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:09.749800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.751648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.765645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 897/1831] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:09.769827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.781966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef558f-7629-4e9e-99c6-db57929f0532 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.786817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.787505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.787790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.788066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.788779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.790806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.818160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 935/1832] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:09 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:09.822514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.833492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1fe69-b7da-4b78-9a39-c62c0214e4fd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.896383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.897147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.897560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.897848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.898639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.900641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.922487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 898/1833] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:09 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:09.924202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.935426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0cb7a-7025-4141-a750-a4405624e8fd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.940269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.940939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.941257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.941540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.942344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.943962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.957140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 936/1834] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:09.961120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:09.971348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5ad4-d916-481d-8833-aa3dab167e71 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:09.975838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:09.976484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:09.976762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:09.977035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:09.977792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:09.979365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9bc77-7710-4c72-ac06-fad2a7d6d22e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:09.989236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 899/1835] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:09.993408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:10.004170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d804a-3b52-4c77-ad87-f61a74fc4cbe admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:10.008802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:10.009712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:10.009992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:10.010265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] PATH_INFO: `/v3/projects/ee8ae3d717a9460cb4d3108b8e181089/users/150fcb9ad9ad472ba5bf2d74e81642a8/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:10.025418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8ae3d717a9460cb4d3108b8e181089, user_id=150fcb9ad9ad472ba5bf2d74e81642a8, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:10.028578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:10.041954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 937/1836] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:09 2022] PUT /identity/v3/projects/ee8ae3d717a9460cb4d3108b8e181089/users/150fcb9ad9ad472ba5bf2d74e81642a8/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:10.048025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f064-7902-423c-89b5-686cd1c4d699 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:10.048316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f064-7902-423c-89b5-686cd1c4d699 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:10.048598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634f064-7902-423c-89b5-686cd1c4d699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:10.068543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d634f064-7902-423c-89b5-686cd1c4d699 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:10.069781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d634f064-7902-423c-89b5-686cd1c4d699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:10.139382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 900/1837] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:10.148943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:10.150729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:10.210076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b947d0-0cae-4f89-869e-0713cdec50b4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:10.213737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:10.214389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:10.214669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:10.215586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:10.225122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:10.226582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:10.237124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 938/1838] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:11.266386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.266932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.266932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.307656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] MFA Rules not processed for user `150fcb9ad9ad472ba5bf2d74e81642a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:11.310550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:11.344377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:11.451072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 901/1839] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:11.455510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.466101 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4837-3bb2-4e0e-bcf4-da203bd30449 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:11.473997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:11.474789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.475178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.475836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.476788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:11.484232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:11.545007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 939/1840] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:11 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:11.545972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.560919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb8afe-96a8-47c1-adc4-39b40e7118b0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:11.671558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:11.672889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.673450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.674057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.675066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:11.677222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:11.708755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 902/1841] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:11 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:11.712714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.723573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d192042-78dc-4485-bc20-d84e76983672 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:11.732740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:11.736229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.736526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.736981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.738325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:11.739968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:11.757922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 940/1842] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:11.759153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.775531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534eed7-d3a7-4482-b87f-1ab4e8f2ef3a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:11.780911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:11.782644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.782644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.782644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] PATH_INFO: `/v3/projects/2d9996a28ea34d9ba96d54767b017439/users/f9fc75bca097427dbfba286c3b8eebea/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.798678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9996a28ea34d9ba96d54767b017439, user_id=f9fc75bca097427dbfba286c3b8eebea, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:11.801545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:11.822320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 903/1843] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:11 2022] PUT /identity/v3/projects/2d9996a28ea34d9ba96d54767b017439/users/f9fc75bca097427dbfba286c3b8eebea/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:11.827046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.842953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de7f8-e2df-4632-b191-55af38765f2d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:11.943060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:11.944078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:11.945054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:11.945054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:11.945948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:11.948362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcedb5-5129-4dc4-b7fc-d1e868b50f74 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:11.951802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:11.967995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 941/1844] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:11.969940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:11.991267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e47f4b-cb9b-4284-bdee-df969a9d24fc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:12.000370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:12.000370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:12.000370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:12.000370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] PATH_INFO: `/v3/projects/2d9996a28ea34d9ba96d54767b017439/users/f9fc75bca097427dbfba286c3b8eebea/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:12.001378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9996a28ea34d9ba96d54767b017439, user_id=f9fc75bca097427dbfba286c3b8eebea, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:12.004368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:12.023837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 904/1845] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:11 2022] PUT /identity/v3/projects/2d9996a28ea34d9ba96d54767b017439/users/f9fc75bca097427dbfba286c3b8eebea/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:13.300712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:13.301234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:13.301350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:13.330301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] MFA Rules not processed for user `f9fc75bca097427dbfba286c3b8eebea`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:13.331528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:13.426215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 942/1846] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:13.439934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:13.442228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:13.528427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0830-a3e6-4028-80bf-1dcd91c2bc1e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:13.532610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:13.533426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:13.533714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:13.533987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:13.608013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:13.654228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:13.655796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:13.666692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 905/1847] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:16.233577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:16.250420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1a3f2-1589-4d2d-bae7-a39b1e66d47d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:16.255396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:16.256134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:16.256643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:16.257361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:16.286115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:16.287568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552533-35ab-484f-afcf-8704b3df284a service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:16.317786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 943/1848] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:16.945695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:16.947283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:17.057154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bb3d9-1809-4be1-8d53-d739923c7be8 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:17.063868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:17.064802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.065087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.065401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] PATH_INFO: `/v3/users/6226d813c60e48468f162d5c32f74531` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.067004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6226d813c60e48468f162d5c32f74531)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:17.069254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:17.129701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6226d813c60e48468f162d5c32f74531'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:17.138523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6226d813c60e48468f162d5c32f74531'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:17.146250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6226d813c60e48468f162d5c32f74531'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:17.159445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6226d813c60e48468f162d5c32f74531'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:17.160109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-00d0ba18-d59b-444e-ad47-5c22c6948daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6226d813c60e48468f162d5c32f74531'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:17.166264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 906/1849] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:16 2022] DELETE /identity/v3/users/6226d813c60e48468f162d5c32f74531 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:17.169246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115090-ec82-401b-b5a9-07c1b5575afb None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.169732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115090-ec82-401b-b5a9-07c1b5575afb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.170215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115090-ec82-401b-b5a9-07c1b5575afb None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.171402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 944/1850] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 23:39:17.171819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.172113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.172392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.181383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.181945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.182229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.192637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:17.193907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:17.202718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:17.203975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:17.248558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:17.267734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 907/1851] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:17.276348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 945/1852] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:39:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:17.277931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:17.279318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:17.289748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:17.291477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:17.305833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffeff78-936e-4fdd-80da-919479a999fe None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:17.311439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:17.312092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.312371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.312645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.322118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:17.324085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:17.336249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 946/1853] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:17.344196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61273-bcff-4a1d-99a7-77a2dfa6468f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:17.352011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:17.352956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:17.353260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:17.353537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:17.366236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:17.367670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:17.379186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 908/1854] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:18.161895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:18.163432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.180105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6b478-1e81-4820-823b-0d2632f85f87 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:18.185964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:18.187411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.188014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.188476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] PATH_INFO: `/v3/users/aecf30ff2a85433baaa09e29e86abd25` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.190545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecf30ff2a85433baaa09e29e86abd25)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:18.193438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:18.249689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:18.253666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecf30ff2a85433baaa09e29e86abd25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.270675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecf30ff2a85433baaa09e29e86abd25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.281627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:18.283303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.289103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecf30ff2a85433baaa09e29e86abd25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.290835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecf30ff2a85433baaa09e29e86abd25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.307401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f900485-d20f-4628-8fbd-21c17b806688 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:18.308621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b52c0558-4008-4d07-a941-2c1b97129ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecf30ff2a85433baaa09e29e86abd25'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.312685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:18.313844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.314295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.314442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] PATH_INFO: `/v3/projects/2a9d6864ab264712a39f20bab0239e18` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.315729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9d6864ab264712a39f20bab0239e18)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:18.318867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 947/1855] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:18 2022] DELETE /identity/v3/users/aecf30ff2a85433baaa09e29e86abd25 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:18.318997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:18.320414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.320705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.321010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.340224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:18.341484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.378878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9d6864ab264712a39f20bab0239e18', 'request_id': 'req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.384318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9d6864ab264712a39f20bab0239e18', 'request_id': 'req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.392540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9d6864ab264712a39f20bab0239e18', 'request_id': 'req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.404622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] The token cache is being invalidate because project 2a9d6864ab264712a39f20bab0239e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:18.404909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.405553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.406864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 948/1856] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:18.407149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 909/1857] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:18 2022] DELETE /identity/v3/projects/2a9d6864ab264712a39f20bab0239e18 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:18.411286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:18.412838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.417303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:18.419470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.425536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5345c2-91d1-4459-a735-eb7e6a34acc4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:18.478033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7dd99-c5a3-4fc8-a16d-7cd3cb487f16 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:18.482490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:18.483063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:18.483184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.483435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.483733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.483939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.484224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.484501 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] PATH_INFO: `/v3/users/44834b64a0d14c5aa34371a0e7d51c90` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.485632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.485814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44834b64a0d14c5aa34371a0e7d51c90)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:18.487755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:18.499214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:18.500628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:18.510434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 910/1858] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:18.535462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44834b64a0d14c5aa34371a0e7d51c90'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.543196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44834b64a0d14c5aa34371a0e7d51c90'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.551070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44834b64a0d14c5aa34371a0e7d51c90'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.551495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44834b64a0d14c5aa34371a0e7d51c90'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.552597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:18.567873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44834b64a0d14c5aa34371a0e7d51c90'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:18.575200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 949/1859] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:18 2022] DELETE /identity/v3/users/44834b64a0d14c5aa34371a0e7d51c90 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:18.829983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:18.831468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:18.845276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6070c84-c7e5-4deb-b0ec-658bcee3397c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:18.863501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:18.921369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:18.924028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:18.924423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:18.925386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] PATH_INFO: `/v3/projects/50cbf1b51fe64fa691b401b6b3cfa1ce` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:18.927823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cbf1b51fe64fa691b401b6b3cfa1ce)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:18.930510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.038126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cbf1b51fe64fa691b401b6b3cfa1ce', 'request_id': 'req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.048508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cbf1b51fe64fa691b401b6b3cfa1ce', 'request_id': 'req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.065282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cbf1b51fe64fa691b401b6b3cfa1ce', 'request_id': 'req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.110448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] The token cache is being invalidate because project 50cbf1b51fe64fa691b401b6b3cfa1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:19.110929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.111727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.126825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 911/1860] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:18 2022] DELETE /identity/v3/projects/50cbf1b51fe64fa691b401b6b3cfa1ce => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:19.128216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.129967 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:19.156920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af486da-3799-452c-b438-9fdaf80ec317 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.162327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.163751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:19.277508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.278692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.279165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.279658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] PATH_INFO: `/v3/users/f4270be91f5f430e9797ea91be755516` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.281078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9179d5-d7b9-42af-8dc8-b0c4c3064ea0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.281694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4270be91f5f430e9797ea91be755516)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.285050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.289141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.290112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.290589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.291014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] PATH_INFO: `/v3/projects/9e3030108712429f90eb6b49d9dc5d1f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.294697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3030108712429f90eb6b49d9dc5d1f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.298731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.375921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4270be91f5f430e9797ea91be755516'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.399375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4270be91f5f430e9797ea91be755516'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.411666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4270be91f5f430e9797ea91be755516'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.413655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4270be91f5f430e9797ea91be755516'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.418571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3030108712429f90eb6b49d9dc5d1f', 'request_id': 'req-722f35b1-5599-46c3-b339-b44b6b57f6d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.420539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:19.427605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3030108712429f90eb6b49d9dc5d1f', 'request_id': 'req-722f35b1-5599-46c3-b339-b44b6b57f6d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.443544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3030108712429f90eb6b49d9dc5d1f', 'request_id': 'req-722f35b1-5599-46c3-b339-b44b6b57f6d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.447505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-367f4c58-2917-4ad5-be0d-41281454e4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4270be91f5f430e9797ea91be755516'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.460876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 950/1861] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:19 2022] DELETE /identity/v3/users/f4270be91f5f430e9797ea91be755516 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:19.462106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] The token cache is being invalidate because project 9e3030108712429f90eb6b49d9dc5d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:19.462508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.463832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-722f35b1-5599-46c3-b339-b44b6b57f6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:19.470697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 912/1862] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:19 2022] DELETE /identity/v3/projects/9e3030108712429f90eb6b49d9dc5d1f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:19.472512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358aa9-41c7-4706-a913-c47012005495 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.472988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358aa9-41c7-4706-a913-c47012005495 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.473462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358aa9-41c7-4706-a913-c47012005495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.510438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-95358aa9-41c7-4706-a913-c47012005495 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:19.514408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-95358aa9-41c7-4706-a913-c47012005495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:19.594795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:19.617250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.617549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.617831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.619826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 951/1863] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:19.657844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:19.659113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:19.677031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 913/1864] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:19.680611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358aa9-41c7-4706-a913-c47012005495 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.692917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358aa9-41c7-4706-a913-c47012005495 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.697978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.699305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.700014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.700014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.700588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:19.700895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.702689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.719903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 952/1865] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:19.722427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.735210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948c3ef-011a-49a0-a510-678d9dec8abb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.741207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.741893 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.742173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.742459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.743371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.745367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.783879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 914/1866] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:19 2022] POST /identity/v3/projects => generated 401 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:19.787929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.799023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f80393-5249-423a-aff0-0e17f45a38c2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.873571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.873976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.874257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.874531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.875230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.877626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.901214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 953/1867] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:19 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:19.904919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.906777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:19.907658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:19.922994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc6c47-a702-46a3-8b92-588b8d4cd3d8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.926383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d0662-b533-4949-a7eb-4c5bdb9f7e92 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:19.935437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.936172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.936611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.936901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.937678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.939534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.955997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:19.955997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:19.955997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:19.955997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] PATH_INFO: `/v3/projects/62783e34483440b6a43bafb7a2819992` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:19.959609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62783e34483440b6a43bafb7a2819992)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:19.963741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:19.971356 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 954/1868] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:19.986388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.029683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7c7c-93b1-42af-967c-97d74d1fb845 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.041415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.042105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.042389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.043364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.046820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.048560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.070603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 955/1869] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:20.076198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.091363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62783e34483440b6a43bafb7a2819992', 'request_id': 'req-edea3465-ef0d-432f-ac4f-7d8d82730d42'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:20.100200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62783e34483440b6a43bafb7a2819992', 'request_id': 'req-edea3465-ef0d-432f-ac4f-7d8d82730d42'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:20.112500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62783e34483440b6a43bafb7a2819992', 'request_id': 'req-edea3465-ef0d-432f-ac4f-7d8d82730d42'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:20.114952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ff66d-95ba-484d-8f23-490881eeb0d3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.129126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] The token cache is being invalidate because project 62783e34483440b6a43bafb7a2819992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:20.129512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:20.130138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-edea3465-ef0d-432f-ac4f-7d8d82730d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:20.132143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 915/1870] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:19 2022] DELETE /identity/v3/projects/62783e34483440b6a43bafb7a2819992 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:20.137963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae828e8-f35a-41c2-9eb1-76f184e8ad44 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.138253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae828e8-f35a-41c2-9eb1-76f184e8ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.138652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae828e8-f35a-41c2-9eb1-76f184e8ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.161519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1ae828e8-f35a-41c2-9eb1-76f184e8ad44 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:20.162888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1ae828e8-f35a-41c2-9eb1-76f184e8ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:20.189655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.190616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.190899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.191179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] PATH_INFO: `/v3/projects/9d4b1157957b4174aae514aabb5d53ea/users/7e5a9e55c1d3487687b3b0bab0f5907a/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.210881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4b1157957b4174aae514aabb5d53ea, user_id=7e5a9e55c1d3487687b3b0bab0f5907a, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.213882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a6870-e5ca-4d33-87be-5e90af206c27 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.236802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 956/1871] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:20 2022] PUT /identity/v3/projects/9d4b1157957b4174aae514aabb5d53ea/users/7e5a9e55c1d3487687b3b0bab0f5907a/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:20.248871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.249575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.249929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.271600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 916/1872] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:20.279398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] MFA Rules not processed for user `7e5a9e55c1d3487687b3b0bab0f5907a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:20.280771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:20.283004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.285460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.286857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.317149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:20.320678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:20.327560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:20.373889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:20.375299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 957/1873] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:20.380294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.382766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:20.430616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 917/1874] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:20.432463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.454663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c0d9-f8d0-46e4-9925-98eed465342c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.461359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.462138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.462485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.462834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.463643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:20.464013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.466369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.485372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 918/1875] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:39:20.486765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.493491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd912-c897-4c0e-8e0e-f9b763dde990 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.501027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b645-55f2-407f-acd6-67d280536fe7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.505845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.506352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.507019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.507294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.507577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.507898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.508264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.508611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.509172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.510105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.510210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.512978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.543669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 919/1876] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:20.545625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.548488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 958/1877] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/projects => generated 395 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:20.549253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.613005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879e628-d1d0-48c3-8f1a-db85700ea7cf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.627421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c407334-50d3-45da-847c-2eaebd7561da admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.644978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.647137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.648625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.648984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.653669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.659842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.688878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.689810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.689924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.690170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.690908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.696086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 959/1878] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/users => generated 304 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:20.696252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.700018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.719538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655e608-893d-4394-8ed3-79e05989a9fa admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.725576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.726260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.726559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.726819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.727808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.730964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.738127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 920/1879] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:20 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:20.742169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.757572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 960/1880] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:20.760311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.774082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa42c-95f3-4789-a2df-4450e268911b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.783019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.783924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.784253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.784533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] PATH_INFO: `/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26/users/1f3cbbba89074356aa0867798864c672/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.784828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ede4b-d6d8-4f7b-82cb-af33c4db4b82 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.799795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.800857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.801643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.802184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.802858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92cb7dcfd7a4b52898ac8337cb77d26, user_id=1f3cbbba89074356aa0867798864c672, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.803313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.805083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.805843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.836346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 961/1881] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:20 2022] PUT /identity/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26/users/1f3cbbba89074356aa0867798864c672/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:20.842392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 921/1882] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:20.842830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.846077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:20.863501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5a3ee-cff3-4ece-b685-089509b1470e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:20.864072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:20.904902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:20.971551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:20.971551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:20.971863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:20.972165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:20.973516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:20.975812 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:20.993344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 922/1883] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:21.002385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.018300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95a76-dae1-42c9-8207-60cf9d57f2fd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.023905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.024611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.024894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.025170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.026249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.029107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.033936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53b86-f64a-4830-8d94-07ea2bd987b6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.045862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 962/1884] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:21.046892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.062076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b236-0e8b-45ac-8448-954d0c1e1687 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.065369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.067999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.068310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.068567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] PATH_INFO: `/v3/projects/fd8c00ba7f914cf488fffcb29c83ea5d/users/c8b0a33688f14390990f0e1d82e1c1e0/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.070711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.072757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.073046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.073355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] PATH_INFO: `/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26/users/1f3cbbba89074356aa0867798864c672/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.079373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92cb7dcfd7a4b52898ac8337cb77d26, user_id=1f3cbbba89074356aa0867798864c672, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.085886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30bb3d-97fd-4a67-8efd-56274f262ecd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.119370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c00ba7f914cf488fffcb29c83ea5d, user_id=c8b0a33688f14390990f0e1d82e1c1e0, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.127450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 963/1885] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:21 2022] PUT /identity/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26/users/1f3cbbba89074356aa0867798864c672/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:21.128369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5db5-4495-4e94-9d38-e2d877c9506e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.139854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.140480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.140480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.161835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 923/1886] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:21 2022] PUT /identity/v3/projects/fd8c00ba7f914cf488fffcb29c83ea5d/users/c8b0a33688f14390990f0e1d82e1c1e0/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:21.172657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.173710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.174122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.195321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] MFA Rules not processed for user `1f3cbbba89074356aa0867798864c672`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:21.196680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:21.239631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] MFA Rules not processed for user `c8b0a33688f14390990f0e1d82e1c1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:21.242470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:21.402443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 964/1887] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:21.407035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 924/1888] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:21.412042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.418387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.421815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:21.561980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ad529-a8e2-43e3-a8f8-df25241947aa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.563178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c7c17-c690-4a73-9685-8f4bc9ad5e71 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.566628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.567873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.569302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.569713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.583528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.585545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.586980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.588095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.590417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.591579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.594299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.595121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.634938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 925/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:21.656413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:21.670224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 965/1890] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:21 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:21.672619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.694703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471e095-3989-4bbe-a50f-c748230d5b5c service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.776021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.790703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:21.867433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.869678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.870033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.871611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.872046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.874474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.897879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1840a-c2bb-4501-8b14-eb7c9616b254 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.901404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 926/1891] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:21 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:21.902415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.906134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.906808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.907092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.907420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.912686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b26ef5-dc4d-4581-b4c0-22e855f69fe1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:21.919756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:21.920532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:21.921502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:21.922494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:21.923587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:21.925741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:21.962865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 927/1892] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:21.963773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:21.998806 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13276618-08b7-43df-9194-e5cc04cd1504 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:22.005674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:22.013121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:22.014649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:22.015632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:22.016710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:22.017104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] PATH_INFO: `/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa/users/46dea8ed7e374b75a0716cca70114b95/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:22.028849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 966/1893] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:22.036336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ecbbcb4a6c4e5a93c249c9851a55aa, user_id=46dea8ed7e374b75a0716cca70114b95, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:22.041271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:22.064324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 928/1894] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:21 2022] PUT /identity/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa/users/46dea8ed7e374b75a0716cca70114b95/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:22.067995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:22.079755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a578-9082-48bc-964e-97a1ec1b0ecd service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:22.153870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:22.154553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:22.154835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:22.155109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:22.155837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:22.157484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1e38b-ed3b-4854-9a58-26926d4458c3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:22.171651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 967/1895] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:22.173204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:22.190000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1db01-7aac-4c33-a334-51bd215400e3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:22.198991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:22.200397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:22.200754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:22.201348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] PATH_INFO: `/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa/users/46dea8ed7e374b75a0716cca70114b95/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:22.204096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ecbbcb4a6c4e5a93c249c9851a55aa, user_id=46dea8ed7e374b75a0716cca70114b95, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:22.207949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:22.250859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 929/1896] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:22 2022] PUT /identity/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa/users/46dea8ed7e374b75a0716cca70114b95/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:22.254970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:22.255271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:22.255588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:22.304673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] MFA Rules not processed for user `46dea8ed7e374b75a0716cca70114b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:22.306110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:22.395572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:22.439503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 968/1897] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:22.450200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:22.537148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aed85a-b534-4020-a9cc-19df36757192 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:22.541436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:22.543542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:22.544465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:22.544752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:22.555250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:22.557214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f83f5-2a29-42dd-94a0-d31fc664e3c1 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:22.569320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 930/1898] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:23.008799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:23.072533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be560a-e069-45fd-b44d-6f4ce3aaf153 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:23.077768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:23.078641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:23.078917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:23.079192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] PATH_INFO: `/v3/users/c8b0a33688f14390990f0e1d82e1c1e0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:23.080379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b0a33688f14390990f0e1d82e1c1e0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:23.082337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:23.141780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b0a33688f14390990f0e1d82e1c1e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.149676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b0a33688f14390990f0e1d82e1c1e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.157562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b0a33688f14390990f0e1d82e1c1e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.158254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b0a33688f14390990f0e1d82e1c1e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.170719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b0a33688f14390990f0e1d82e1c1e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.176963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 969/1899] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:23 2022] DELETE /identity/v3/users/c8b0a33688f14390990f0e1d82e1c1e0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:23.181402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:23.181699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:23.182011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:23.200177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:23.201412 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:23.260708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 931/1900] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:23.270181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:23.271560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:23.327828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594eaa-a75c-4ffa-9e33-3b40e6051c46 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:23.331598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:23.332266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:23.332549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:23.332816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:23.343178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:23.344593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:23.348456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:23.357027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 970/1901] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:23.635470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:23.638251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:23.660097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41215d3-61dd-459d-8519-713d1bcdb6ea None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:23.665838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:23.668420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:23.669282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:23.669842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] PATH_INFO: `/v3/projects/fd8c00ba7f914cf488fffcb29c83ea5d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:23.671952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8c00ba7f914cf488fffcb29c83ea5d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:23.673972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:23.682522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:23.724664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8c00ba7f914cf488fffcb29c83ea5d', 'request_id': 'req-3b3a1502-3741-495a-b639-79123a9e6506'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.730849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8c00ba7f914cf488fffcb29c83ea5d', 'request_id': 'req-3b3a1502-3741-495a-b639-79123a9e6506'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.739586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8c00ba7f914cf488fffcb29c83ea5d', 'request_id': 'req-3b3a1502-3741-495a-b639-79123a9e6506'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.752371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] The token cache is being invalidate because project fd8c00ba7f914cf488fffcb29c83ea5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:23.752660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.753332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.754891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 932/1902] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:23 2022] DELETE /identity/v3/projects/fd8c00ba7f914cf488fffcb29c83ea5d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:23.758833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:23.768846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db635461-bb5f-46c0-94c7-c12b2333cd78 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:23.825298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:23.826234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:23.826521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:23.826801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] PATH_INFO: `/v3/users/46dea8ed7e374b75a0716cca70114b95` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:23.828211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dea8ed7e374b75a0716cca70114b95)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:23.830169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:23.877578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dea8ed7e374b75a0716cca70114b95'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.884781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dea8ed7e374b75a0716cca70114b95'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.891827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dea8ed7e374b75a0716cca70114b95'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.892459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dea8ed7e374b75a0716cca70114b95'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.905790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6a606f50-cb73-4231-8617-8dd78cb209ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dea8ed7e374b75a0716cca70114b95'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:23.911731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 971/1903] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:23 2022] DELETE /identity/v3/users/46dea8ed7e374b75a0716cca70114b95 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:24.336019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.337656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:24.352433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1502-3741-495a-b639-79123a9e6506 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.413433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.414308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.414594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.414870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] PATH_INFO: `/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.416078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ecbbcb4a6c4e5a93c249c9851a55aa)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.418662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.465232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ecbbcb4a6c4e5a93c249c9851a55aa', 'request_id': 'req-21936537-1216-4f20-a573-18e4f2cb1898'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:24.470864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ecbbcb4a6c4e5a93c249c9851a55aa', 'request_id': 'req-21936537-1216-4f20-a573-18e4f2cb1898'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:24.479277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ecbbcb4a6c4e5a93c249c9851a55aa', 'request_id': 'req-21936537-1216-4f20-a573-18e4f2cb1898'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:24.492580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] The token cache is being invalidate because project c5ecbbcb4a6c4e5a93c249c9851a55aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:24.492882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:24.493577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-21936537-1216-4f20-a573-18e4f2cb1898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:24.499628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 933/1904] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:24 2022] DELETE /identity/v3/projects/c5ecbbcb4a6c4e5a93c249c9851a55aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:24.502522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.503102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.503395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.530207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:24.533281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:24.638154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 972/1905] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:24.640968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.641523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.641643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.662057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:24.663452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:24.676842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 934/1906] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:24.678400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.690250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b9c8d-4486-4d01-a2cd-a632ae74e1ea None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.695188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.695869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.696153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.696438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.697398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:24.697712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.700128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.717381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 973/1907] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:24.721948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.732358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cefd03-141b-4d33-a195-a94c2e17adf1 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.737234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.737899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.738184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.738459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.739163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.741087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.764921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:24.777260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 935/1908] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:24 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:24.781217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.787848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:24.792973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b3588-f305-4b04-a844-174fc3d702ce admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.869995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.871246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.871591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.871796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.872494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.874913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.897284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 974/1909] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:24 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:24.901084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.912372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291fc90-e300-40f7-bd6f-bb569cb008ba admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.917951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.919074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.919074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.919264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.919984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.921617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.932801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 936/1910] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:24.936985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.947117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574efaa4-90ac-40ba-a1ce-d31b5433a255 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.953972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.954642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.954929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.955211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:24.955934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:24.957580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0ad2a-36f2-4eba-b99b-f36b57123186 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:24.968529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 975/1911] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:24.972466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:24.984525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe265ad-a49b-4e32-9215-1afdaf19c277 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:24.990009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:24.990885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:24.991167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:24.991444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] PATH_INFO: `/v3/projects/4021af0b335e4872a660aa9d7060c750/users/3dfae791d8914f2b84f3d3f5ae208841/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.005959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4021af0b335e4872a660aa9d7060c750, user_id=3dfae791d8914f2b84f3d3f5ae208841, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.008581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.021314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 937/1912] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:24 2022] PUT /identity/v3/projects/4021af0b335e4872a660aa9d7060c750/users/3dfae791d8914f2b84f3d3f5ae208841/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:25.032048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.032345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.032627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.059260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] MFA Rules not processed for user `3dfae791d8914f2b84f3d3f5ae208841`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:25.060474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:25.124704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 976/1913] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:25.129129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.190543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618a9e-39a1-499c-a176-9442f450a4a0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.195146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.195888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.196077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.196351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.197036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.199488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.230558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 938/1914] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:25 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:25.231751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.242740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda207a-6305-455a-b1fd-f721d53cd95d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.304661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.305376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.305664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.305945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.306644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.308615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.333224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 977/1915] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:25 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:25.336172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.352181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f22c-98a9-40a6-a49b-0bfefb83d685 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.357038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.357910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.358200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.358477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.359203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.360818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.372049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 939/1916] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:25.376710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.381905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:25.389339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2f4ac-5a28-4d14-b284-54f78b68f831 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.394238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.395121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.395402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.395678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] PATH_INFO: `/v3/projects/28356706156b459080ff213c8576feed/users/661d2cbfbae14b0abef4f760d99c5fc0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.412257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28356706156b459080ff213c8576feed, user_id=661d2cbfbae14b0abef4f760d99c5fc0, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.414892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.432153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 978/1917] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:25 2022] PUT /identity/v3/projects/28356706156b459080ff213c8576feed/users/661d2cbfbae14b0abef4f760d99c5fc0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:25.437035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.447445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2737-b482-49a7-89c6-2ed66e3346a1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.511737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.512124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.512413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.512695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.513492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.515061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afee5a1-f245-4d9d-982e-2dba8a28cfd6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.525233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 940/1918] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:25.529968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.540313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fcc-ea32-493a-a7e9-3c0ff94a2d8e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.545777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.546690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.546977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.547257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] PATH_INFO: `/v3/projects/28356706156b459080ff213c8576feed/users/661d2cbfbae14b0abef4f760d99c5fc0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.549272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28356706156b459080ff213c8576feed, user_id=661d2cbfbae14b0abef4f760d99c5fc0, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.551918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.563221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 979/1919] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:25 2022] PUT /identity/v3/projects/28356706156b459080ff213c8576feed/users/661d2cbfbae14b0abef4f760d99c5fc0/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:25.578291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.578291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.578291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.604815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] MFA Rules not processed for user `661d2cbfbae14b0abef4f760d99c5fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:25.606716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:25.627658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:25.678545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 941/1920] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:25.690653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.692592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:25.755729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30fc1-9171-4d17-b0c5-1cc91010ce98 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.759495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.760152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.760438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.760715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.770272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.771746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.782225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 980/1921] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:25.887100 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:25.888630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:25.900668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7295f8-48ff-4f37-a7ff-586caf70ad8d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:25.905303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:25.905953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:25.906234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:25.906507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:25.968253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:25.969739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42753ce-bf90-43dd-ab5c-c615d1a511c0 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:25.980683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 942/1922] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:26.249629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:26.311512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9feee-5f90-42d5-a4d4-153ed3c2e041 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:26.316183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:26.317055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:26.317378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:26.317660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] PATH_INFO: `/v3/users/3dfae791d8914f2b84f3d3f5ae208841` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:26.318848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfae791d8914f2b84f3d3f5ae208841)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:26.320764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:26.367355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfae791d8914f2b84f3d3f5ae208841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:26.375815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfae791d8914f2b84f3d3f5ae208841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:26.383506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfae791d8914f2b84f3d3f5ae208841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:26.384110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfae791d8914f2b84f3d3f5ae208841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:26.390907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:26.398953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfae791d8914f2b84f3d3f5ae208841'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:26.406661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 981/1923] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:26 2022] DELETE /identity/v3/users/3dfae791d8914f2b84f3d3f5ae208841 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:26.411086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:26.411379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:26.411668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:26.428909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:26.430171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:26.490546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 943/1924] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:26.502042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:26.503637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:26.570984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b05338-a43c-4760-ab38-7453928fa5a0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:26.575601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:26.576286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:26.576569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:26.576849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:26.586754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:26.588622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:26.599879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 982/1925] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:26.907253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:26.909444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:26.924745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fcade-c4bd-4712-bc62-e0628bf0b102 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:26.932054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:26.932517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:26.933440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:26.933731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] PATH_INFO: `/v3/projects/4021af0b335e4872a660aa9d7060c750` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:26.935152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4021af0b335e4872a660aa9d7060c750)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:26.937171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:27.001613 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4021af0b335e4872a660aa9d7060c750', 'request_id': 'req-ba90c868-5f21-4258-a53c-2d1f90468555'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.003550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:27.008337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4021af0b335e4872a660aa9d7060c750', 'request_id': 'req-ba90c868-5f21-4258-a53c-2d1f90468555'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.015821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4021af0b335e4872a660aa9d7060c750', 'request_id': 'req-ba90c868-5f21-4258-a53c-2d1f90468555'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.028997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] The token cache is being invalidate because project 4021af0b335e4872a660aa9d7060c750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:27.029403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.030101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.031770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 944/1926] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:26 2022] DELETE /identity/v3/projects/4021af0b335e4872a660aa9d7060c750 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:27.035562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:27.046650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e05f-763c-4843-a61f-1a2c86ad9495 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:27.106689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:27.107583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:27.107865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:27.108137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] PATH_INFO: `/v3/users/661d2cbfbae14b0abef4f760d99c5fc0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:27.109536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] RBAC: Authorizing `identity:delete_user(user_id=661d2cbfbae14b0abef4f760d99c5fc0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:27.111515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:27.163475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661d2cbfbae14b0abef4f760d99c5fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.174349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661d2cbfbae14b0abef4f760d99c5fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.182244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661d2cbfbae14b0abef4f760d99c5fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.183060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661d2cbfbae14b0abef4f760d99c5fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.199108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-db719c77-7983-4e10-9e8c-d522a1f7151c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661d2cbfbae14b0abef4f760d99c5fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.209804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 983/1927] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:27 2022] DELETE /identity/v3/users/661d2cbfbae14b0abef4f760d99c5fc0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:27.501056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:27.502584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:27.518067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90c868-5f21-4258-a53c-2d1f90468555 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:27.599293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:27.600708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:27.600708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:27.601324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] PATH_INFO: `/v3/projects/28356706156b459080ff213c8576feed` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:27.604133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28356706156b459080ff213c8576feed)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:27.607884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:27.677427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28356706156b459080ff213c8576feed', 'request_id': 'req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.686748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28356706156b459080ff213c8576feed', 'request_id': 'req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.710323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28356706156b459080ff213c8576feed', 'request_id': 'req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.728336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] The token cache is being invalidate because project 28356706156b459080ff213c8576feed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:27.728625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.729348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f94e8c75-a1a1-4402-93f6-85e3d4c8404a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:27.736287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 945/1928] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:27 2022] DELETE /identity/v3/projects/28356706156b459080ff213c8576feed => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:27.737424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:27.737782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:27.738151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:27.761922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:27.764719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:27.774059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:27.900597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 984/1929] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:27.907856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:27.908373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:27.908373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:27.935371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:27.936588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:27.946528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 946/1930] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:27.951594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:27.969574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85dd76-152c-4dbc-a9c3-133f6f27eb32 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:27.980695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:27.981626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:27.981968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:27.982200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:27.985938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:27.986542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:27.990460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.015656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 985/1931] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:28.020384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.037975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bd7f3-d02a-428b-83ec-0cc1e1b1163d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.045618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.046358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.046574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.046851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.050231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.055147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.120626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 947/1932] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:28 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:28.124874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.138075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff0e3-385a-4488-b3b4-d83b1d8b975a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.221066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.221740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.222067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.222310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.223004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.225116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.252743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 986/1933] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:28 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:28.257865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.278259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0391919-40f7-4c9a-af7c-9135a7502d17 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.296037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.296802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.297130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.297538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.298193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.300146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.315533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 948/1934] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:28.320250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.337487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439fc10-85a7-456f-804e-e13a83c432f9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.349924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.350857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.351519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.351760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.352641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.357091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff5a1b-6cb9-4a04-82bc-61c042aba26d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.379124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 987/1935] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:28.383373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.418525 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb25c18-df49-458f-ba53-d57a187a9df8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.428387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.430490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.430987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.431469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] PATH_INFO: `/v3/projects/3e497a5781234c82973af110a8faab1e/users/010c73a8a43d42fb83272760952b80e6/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.463936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e497a5781234c82973af110a8faab1e, user_id=010c73a8a43d42fb83272760952b80e6, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.468689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.494684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 949/1936] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:28 2022] PUT /identity/v3/projects/3e497a5781234c82973af110a8faab1e/users/010c73a8a43d42fb83272760952b80e6/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:28.506491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.506791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.507058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.586940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] MFA Rules not processed for user `010c73a8a43d42fb83272760952b80e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:28.588319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:28.683821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.689585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 988/1937] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:28.689740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:28.695569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:28.698228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.699678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:28.705241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:28.763821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cfc792-e46f-4ce5-a84c-7b7a860c8b16 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.770000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.770917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.771707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.771997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] PATH_INFO: `/v3/users/7e5a9e55c1d3487687b3b0bab0f5907a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.773544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5a9e55c1d3487687b3b0bab0f5907a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.775997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.799944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbae7c2-7e80-4557-a775-c12e28ba0eeb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:28.804558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:28.805386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.805843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.806213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.816123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:28.817658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31d790-3ac2-441f-a2b6-48f4210b7c50 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:28.829062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 989/1938] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:28.840675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5a9e55c1d3487687b3b0bab0f5907a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:28.850905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5a9e55c1d3487687b3b0bab0f5907a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:28.860129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5a9e55c1d3487687b3b0bab0f5907a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:28.876597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5a9e55c1d3487687b3b0bab0f5907a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:28.877544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5a9e55c1d3487687b3b0bab0f5907a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:28.885229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 950/1939] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:28 2022] DELETE /identity/v3/users/7e5a9e55c1d3487687b3b0bab0f5907a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:28.889719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:28.890010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:28.890372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:28.909172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:28.910408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:28.984529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 990/1940] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:28.994612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:28.996202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:29.129597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f533a94-d25b-4447-8018-1ae77b68dbc5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:29.154296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:29.156606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:29.156900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:29.157225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:29.174573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:29.176189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:29.189416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 951/1941] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:29.515759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:29.517711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:29.537639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b3d86-ae2c-4a61-a19d-fe142ab49515 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:29.543679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:29.544984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:29.545347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:29.545709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] PATH_INFO: `/v3/projects/9d4b1157957b4174aae514aabb5d53ea` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:29.550069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4b1157957b4174aae514aabb5d53ea)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:29.550662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:29.710679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4b1157957b4174aae514aabb5d53ea', 'request_id': 'req-1f4b04e4-29a4-41b1-a871-fe553ea60408'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:29.724214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4b1157957b4174aae514aabb5d53ea', 'request_id': 'req-1f4b04e4-29a4-41b1-a871-fe553ea60408'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:29.740531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4b1157957b4174aae514aabb5d53ea', 'request_id': 'req-1f4b04e4-29a4-41b1-a871-fe553ea60408'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:29.769618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] The token cache is being invalidate because project 9d4b1157957b4174aae514aabb5d53ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:29.769974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:29.771430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:29.773464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 991/1942] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:29 2022] DELETE /identity/v3/projects/9d4b1157957b4174aae514aabb5d53ea => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:29.777920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:29.792089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03968-db3b-4080-9bdd-293c1f021c70 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:29.856716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:29.922534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:29.924551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:29.924551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:29.924855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] PATH_INFO: `/v3/users/1f3cbbba89074356aa0867798864c672` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:29.926409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3cbbba89074356aa0867798864c672)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:29.928614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:30.010078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3cbbba89074356aa0867798864c672'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.024206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3cbbba89074356aa0867798864c672'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.037759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3cbbba89074356aa0867798864c672'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.067704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3cbbba89074356aa0867798864c672'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.069771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-853816c4-3d73-4a89-b1b0-199d7a7badd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3cbbba89074356aa0867798864c672'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.085503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 952/1943] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:29 2022] DELETE /identity/v3/users/1f3cbbba89074356aa0867798864c672 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:30.584010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:30.586259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:30.608769 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b04e4-29a4-41b1-a871-fe553ea60408 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:30.618807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:30.686100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:30.687299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:30.687677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:30.688022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] PATH_INFO: `/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:30.689386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92cb7dcfd7a4b52898ac8337cb77d26)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:30.691272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:30.760156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92cb7dcfd7a4b52898ac8337cb77d26', 'request_id': 'req-33fd1fa3-c2ce-425c-b11a-ed24923e1622'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.766777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92cb7dcfd7a4b52898ac8337cb77d26', 'request_id': 'req-33fd1fa3-c2ce-425c-b11a-ed24923e1622'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.773200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92cb7dcfd7a4b52898ac8337cb77d26', 'request_id': 'req-33fd1fa3-c2ce-425c-b11a-ed24923e1622'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.785817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] The token cache is being invalidate because project b92cb7dcfd7a4b52898ac8337cb77d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:30.786102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.786889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-33fd1fa3-c2ce-425c-b11a-ed24923e1622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:30.788511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 992/1944] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:30 2022] DELETE /identity/v3/projects/b92cb7dcfd7a4b52898ac8337cb77d26 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:30.794011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:30.794305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:30.794580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:30.812871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:30.814125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:30.893391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 953/1945] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:30.900728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:30.901286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:30.902361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:30.922589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:30.923826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:30.932356 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 993/1946] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:30.936829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:30.947296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc4aa-5bb4-4b1b-a61d-0744daefa984 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:30.954151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:30.955042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:30.955381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:30.955680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:30.956608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:30.956949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:30.959023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:30.974654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 954/1947] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:30.979424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:30.989760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbc71-e1a7-454c-a3e5-a3e8e695a257 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:30.995549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:30.996294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:30.996585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:30.996857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:30.997624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:30.999978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.039155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 994/1948] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:30 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:31.041369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:31.063395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb0a6f-eb8d-4771-bdd5-d83b301715bf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:31.112516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:31.179091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:31.179906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.180198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.180478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.182901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:31.186841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.225082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 955/1949] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:31 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:31.231007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:31.243134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95637e9-dc66-4e41-b025-632f093195d8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:31.249799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:31.251086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.251596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.252069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.253017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:31.255360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.270419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 995/1950] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:31.274274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:31.297443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77f34-dfa6-4b91-9db0-4e19f58346a4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:31.304682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:31.305777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.306229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.306687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.308428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:31.311305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f3ee6-e052-4c96-a779-8e521b728fb1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.333237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 956/1951] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:31.336171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:31.350542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104441c3-ba3c-4fc0-a3f5-05c500527b52 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:31.358378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:31.359285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.361690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.362144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] PATH_INFO: `/v3/projects/3b440a72f95940bf8366efc7bee9a348/users/246cb41613e6465c8062439a81995690/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.384422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b440a72f95940bf8366efc7bee9a348, user_id=246cb41613e6465c8062439a81995690, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:31.388858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.435846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 996/1952] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:31 2022] PUT /identity/v3/projects/3b440a72f95940bf8366efc7bee9a348/users/246cb41613e6465c8062439a81995690/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:31.446434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.446749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.447030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.527221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] MFA Rules not processed for user `246cb41613e6465c8062439a81995690`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:31.530426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:31.649495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 957/1953] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:31.683961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:31.686178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:31.770299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:31.828517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff933-da86-4c89-b828-9f174ef9b9bd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:31.837956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:31.850007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:31.850507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:31.850966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:31.869026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:31.870844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee73eed-d104-4008-81d6-39bc11ba13c2 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:31.883848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 997/1954] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:31.909259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:32.004477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fafa70-22fc-4adc-b969-3c94f247e21a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:32.009224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:32.010102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:32.010385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:32.010660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] PATH_INFO: `/v3/users/246cb41613e6465c8062439a81995690` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:32.012578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246cb41613e6465c8062439a81995690)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:32.014567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:32.070183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:32.072703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246cb41613e6465c8062439a81995690'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:32.084608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246cb41613e6465c8062439a81995690'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:32.098572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246cb41613e6465c8062439a81995690'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:32.124547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246cb41613e6465c8062439a81995690'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:32.125298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246cb41613e6465c8062439a81995690'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:32.131438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 958/1955] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:31 2022] DELETE /identity/v3/users/246cb41613e6465c8062439a81995690 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:32.136561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:32.137013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:32.137335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:32.156733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:32.158531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:32.239203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 998/1956] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:32.251292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:32.255210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:32.410578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b75b-0e79-419e-b86c-43cf919a03d3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:32.419992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:32.420663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:32.420942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:32.421238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:32.432487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:32.434720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1530b4d-1a38-459f-bd60-190629cf2a12 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:32.464454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 959/1957] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:32.910129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:32.920669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:32.955504 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb6d82-2ff6-4e9d-b97f-a601e4acc41a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:32.966663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:32.969407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:32.969900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:32.970506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] PATH_INFO: `/v3/projects/3b440a72f95940bf8366efc7bee9a348` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:32.972269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b440a72f95940bf8366efc7bee9a348)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:32.977072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.120371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b440a72f95940bf8366efc7bee9a348', 'request_id': 'req-83ea4a8d-4827-4b20-b447-10fc93dcee81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:33.132458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b440a72f95940bf8366efc7bee9a348', 'request_id': 'req-83ea4a8d-4827-4b20-b447-10fc93dcee81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:33.147531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b440a72f95940bf8366efc7bee9a348', 'request_id': 'req-83ea4a8d-4827-4b20-b447-10fc93dcee81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:33.194624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] The token cache is being invalidate because project 3b440a72f95940bf8366efc7bee9a348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:33.194929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:33.200420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-83ea4a8d-4827-4b20-b447-10fc93dcee81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:33.203563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 999/1958] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:32 2022] DELETE /identity/v3/projects/3b440a72f95940bf8366efc7bee9a348 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:33.208981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.209556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.209556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.240935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:33.246246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:33.459522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 960/1959] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:33.474178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.474656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.475197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.520094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:33.528570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:33.538990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1000/1960] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:33.544485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.557106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c24b4e-0873-4b90-be90-686fb703ac27 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.568155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.569669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.570055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.570340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.571280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:33.571591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.573362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.587316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 961/1961] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:33.591842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.601927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13325c-982f-4f77-a327-7df5b8bb00eb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.610312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.611533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.611864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.612206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.612974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.614866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.645019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1001/1962] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:33 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:33.649684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.665925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f842-a82b-4b3d-945a-6a8f8dd684ee admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.745943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:33.758653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.759721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.762959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.763582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.765091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.769027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.811690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.822432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 962/1963] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:33 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:33.828663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281d79-4cb0-4835-bf8a-d43cd6fa875d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.840139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.842186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.844515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.845036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.848153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.852465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.878574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1002/1964] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:33.883048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.895473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735277-caf7-4c3a-b360-86f2276268a9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.905800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.906658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.906939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.909362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.910144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.911775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91c45d-94ab-4b82-a6e4-d605658e392d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:33.939307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 963/1965] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:33.943255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:33.954782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c475f32-082b-4c9a-8045-f7f90f4bd6ff admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:33.961663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:33.962695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:33.962911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:33.963190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] PATH_INFO: `/v3/projects/71dbc4d159d545de8c6ad3755085e26b/users/a33eb0d95d404eef8897ac3510fd2fb6/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:33.992230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dbc4d159d545de8c6ad3755085e26b, user_id=a33eb0d95d404eef8897ac3510fd2fb6, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:33.999768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.016669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:34.038306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1003/1966] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:33 2022] PUT /identity/v3/projects/71dbc4d159d545de8c6ad3755085e26b/users/a33eb0d95d404eef8897ac3510fd2fb6/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:34.039960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.040785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.040785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.074040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] MFA Rules not processed for user `a33eb0d95d404eef8897ac3510fd2fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:34.075273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:34.191538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 964/1967] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:34.193353 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.281565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac501936-66ed-4427-9c5e-0ae2cfaada9f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.286810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.287906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.287906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.288104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.288862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.290762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.338833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1004/1968] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:34 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:34.343896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.358818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a6c87-cb77-4074-be7f-93c4341f7244 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.514176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.514890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.515164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.515439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.516150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.524910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.575305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 965/1969] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:34 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:34.582304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.598439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57515322-fbae-4b7f-a2f7-2f1fc9b9b5b9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.602970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.603711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.604001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.604279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.605048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.606771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.635213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1005/1970] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:34.635772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.657650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2fb50-c712-4ab6-b259-d5f809e48cb6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.664801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.668362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.670646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.671105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] PATH_INFO: `/v3/projects/c383d76f551b4424ba67556c3bbd2705/users/e7a8336af2814cbea974786856d91c76/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.692089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c383d76f551b4424ba67556c3bbd2705, user_id=e7a8336af2814cbea974786856d91c76, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.695243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.725641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.725961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 966/1971] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:34 2022] PUT /identity/v3/projects/c383d76f551b4424ba67556c3bbd2705/users/e7a8336af2814cbea974786856d91c76/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:34.740795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8ddc9-9350-4acc-8e81-28f453abc45c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.830814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.831783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.832217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.832835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.834027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.836715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7fa50-702d-4cc0-8007-c47b7ad29dce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.849936 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1006/1972] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:34.855210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:34.869216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25e553-64b8-48db-b87e-6687441099d8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:34.875875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:34.877418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.878067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.878614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] PATH_INFO: `/v3/projects/c383d76f551b4424ba67556c3bbd2705/users/e7a8336af2814cbea974786856d91c76/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.881172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c383d76f551b4424ba67556c3bbd2705, user_id=e7a8336af2814cbea974786856d91c76, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:34.884344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:34.926891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 967/1973] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:34 2022] PUT /identity/v3/projects/c383d76f551b4424ba67556c3bbd2705/users/e7a8336af2814cbea974786856d91c76/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:34.939997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e974bd-d36f-4b61-8198-44b5e8590f8f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:34.940854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e974bd-d36f-4b61-8198-44b5e8590f8f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:34.941364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e974bd-d36f-4b61-8198-44b5e8590f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:34.999496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-10e974bd-d36f-4b61-8198-44b5e8590f8f None None] MFA Rules not processed for user `e7a8336af2814cbea974786856d91c76`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:35.003783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-10e974bd-d36f-4b61-8198-44b5e8590f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:35.083255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:35.095728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1007/1974] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:35.112754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:35.116949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:35.153932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:35.214008 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3638a8-15af-4d6f-bd5c-5c35ef4eb235 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:35.219181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:35.219860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:35.220291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:35.220578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:35.297365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:35.300786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd46e3b-a91d-4775-8f1e-ddc780b871c0 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:35.322499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 968/1975] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:35.828066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:35.829616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:35.830006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:35.832986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1008/1976] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:39:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:39:35.840653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:35.841174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:35.842377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:35.878144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:35.879635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:35.981606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 969/1977] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:39:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:36.002578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:36.008717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:36.032795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97540b0-36c1-48e0-be33-f035d7f2b754 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:36.047913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:36.048658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:36.049107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:36.049291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:36.062596 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:36.066211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:36.087813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1009/1978] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:36.510708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:36.512260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:36.582086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b452b-6d64-47f1-b43a-006bb7255e96 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:36.586759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:36.587716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:36.587946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:36.588221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] PATH_INFO: `/v3/users/150fcb9ad9ad472ba5bf2d74e81642a8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:36.589630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=150fcb9ad9ad472ba5bf2d74e81642a8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:36.591566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:36.597061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:36.650764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150fcb9ad9ad472ba5bf2d74e81642a8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:36.659633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150fcb9ad9ad472ba5bf2d74e81642a8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:36.667981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150fcb9ad9ad472ba5bf2d74e81642a8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:36.682310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150fcb9ad9ad472ba5bf2d74e81642a8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:36.683792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150fcb9ad9ad472ba5bf2d74e81642a8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:36.690183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 970/1979] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:36 2022] DELETE /identity/v3/users/150fcb9ad9ad472ba5bf2d74e81642a8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:36.889153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:36.899845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194855c2-3073-4a62-a5f2-3a0867fd3a8b service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:36.961163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:36.962073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:36.962360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:36.962637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] PATH_INFO: `/v3/projects/ee8ae3d717a9460cb4d3108b8e181089` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:36.964488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8ae3d717a9460cb4d3108b8e181089)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:36.966457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.024214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8ae3d717a9460cb4d3108b8e181089', 'request_id': 'req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.030905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8ae3d717a9460cb4d3108b8e181089', 'request_id': 'req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.037251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8ae3d717a9460cb4d3108b8e181089', 'request_id': 'req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.057132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] The token cache is being invalidate because project ee8ae3d717a9460cb4d3108b8e181089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:37.057511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.058278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.060088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1010/1980] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:36 2022] DELETE /identity/v3/projects/ee8ae3d717a9460cb4d3108b8e181089 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:37.064121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.065890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:37.080321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4ceda-3ebd-48f7-9817-318ee43a5ebb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.182970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.183896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.184181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.184460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] PATH_INFO: `/v3/users/f9fc75bca097427dbfba286c3b8eebea` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.186200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9fc75bca097427dbfba286c3b8eebea)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.188494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.238698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9fc75bca097427dbfba286c3b8eebea'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.246536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9fc75bca097427dbfba286c3b8eebea'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.254477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9fc75bca097427dbfba286c3b8eebea'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.270815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9fc75bca097427dbfba286c3b8eebea'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.271578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9f13932b-c96d-4f35-b8c8-fbaeda156ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9fc75bca097427dbfba286c3b8eebea'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.278285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 971/1981] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:37 2022] DELETE /identity/v3/users/f9fc75bca097427dbfba286c3b8eebea => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:37.447261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.449634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:37.465138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829b5b6-87f5-4eac-8f3c-3a7db0d37d41 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.522226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.523088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.523372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.523644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] PATH_INFO: `/v3/projects/2d9996a28ea34d9ba96d54767b017439` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.524848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9996a28ea34d9ba96d54767b017439)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.526971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.542365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:37.574250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9996a28ea34d9ba96d54767b017439', 'request_id': 'req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.579744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9996a28ea34d9ba96d54767b017439', 'request_id': 'req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.585852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9996a28ea34d9ba96d54767b017439', 'request_id': 'req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.598192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] The token cache is being invalidate because project 2d9996a28ea34d9ba96d54767b017439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:37.598492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.599107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-43ff11e2-6d2d-4ce1-bcd3-75c9b6c68418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:37.600645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1011/1982] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:37 2022] DELETE /identity/v3/projects/2d9996a28ea34d9ba96d54767b017439 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:37.606559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.606855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.607141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.613523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:37.628898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:37.630105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:37.689288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 972/1983] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:37.697062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.697387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.697667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.716784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:37.718021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:37.725877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1012/1984] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:37.730129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.740060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa807ddb-3f14-4aef-8bc4-2efd1e2b2175 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.744727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.746122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.746392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.746674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.747400 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:37.747964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.749590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.765645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 973/1985] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:37.775131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.778745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4ac8-92ef-436f-a49b-490e0082e89d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.783682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.784351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.784635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.784914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.785654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.787643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.817163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1013/1986] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:37 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:37.818263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.829132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915fdb6-303d-4c95-bb69-da6a90ad7ad8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.888150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.888776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.889060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.889427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.890122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.892061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.911171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 974/1987] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:37 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:37.915185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.925387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc22449-068a-49c4-a048-353501099fc0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.929895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.930549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.930834 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.931113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.931838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.933496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.944392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1014/1988] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:37.948665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.958856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b83247-45d7-45e4-a4d4-182fb20704ef admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.963401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.964288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.964569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.964843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:37.965642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:37.967439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c107d-02f4-47e4-af61-883e4ded3b22 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:37.978486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 975/1989] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:37.982867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:37.992909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8e344-fd4d-48c4-a3aa-c41a5c387ec8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:37.998026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:37.998906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:37.999213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:37.999490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] PATH_INFO: `/v3/projects/b6b594d577cd4f38b115c0f1c02d10b7/users/e5b47465e61c4cd68bdde5abe565313a/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:38.014578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b594d577cd4f38b115c0f1c02d10b7, user_id=e5b47465e61c4cd68bdde5abe565313a, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:38.017246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:38.031371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1015/1990] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:37 2022] PUT /identity/v3/projects/b6b594d577cd4f38b115c0f1c02d10b7/users/e5b47465e61c4cd68bdde5abe565313a/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:38.042416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:38.042750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:38.043040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:38.073820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] MFA Rules not processed for user `e5b47465e61c4cd68bdde5abe565313a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:38.075051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:38.161209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:38.169120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 976/1991] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:38.182278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:38.185940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:38.267878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7f97a-b47f-4800-a3d4-bba77b44be9c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:38.272442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:38.273254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:38.273600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:38.274060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:38.284041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:38.285508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b14b27-8e61-456f-bc7e-524155bca156 service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:38.296025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1016/1992] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:40.166448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:40.169006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:40.239380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914877f-0280-431f-b1e2-b47cd422c057 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:40.244007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:40.245573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:40.245860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:40.246173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] PATH_INFO: `/v3/users/a33eb0d95d404eef8897ac3510fd2fb6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:40.247439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33eb0d95d404eef8897ac3510fd2fb6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:40.249661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:40.300993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33eb0d95d404eef8897ac3510fd2fb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.315114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33eb0d95d404eef8897ac3510fd2fb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.322751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33eb0d95d404eef8897ac3510fd2fb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.346504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33eb0d95d404eef8897ac3510fd2fb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.347300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33eb0d95d404eef8897ac3510fd2fb6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.353877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 977/1993] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:40 2022] DELETE /identity/v3/users/a33eb0d95d404eef8897ac3510fd2fb6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:40.359048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:40.359550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:40.359760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:40.380047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:40.381315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:40.424119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:40.445835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1017/1994] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:40.455898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:40.457304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:40.516770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc94faf-9887-4bcc-aa5d-6efbb56ace1d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:40.520541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:40.521212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:40.521521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:40.521801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:40.531700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:40.533112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:40.543282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 978/1995] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:40.878888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:40.881904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:40.897550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df30a3-13d2-40fb-a38a-f66e76517117 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:40.911364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:40.912387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:40.913715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:40.914010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] PATH_INFO: `/v3/projects/71dbc4d159d545de8c6ad3755085e26b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:40.925212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dbc4d159d545de8c6ad3755085e26b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:40.925212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:40.976404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dbc4d159d545de8c6ad3755085e26b', 'request_id': 'req-ced13f71-f46e-4522-b60e-cbadb5dc98f4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.982552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dbc4d159d545de8c6ad3755085e26b', 'request_id': 'req-ced13f71-f46e-4522-b60e-cbadb5dc98f4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:40.988662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dbc4d159d545de8c6ad3755085e26b', 'request_id': 'req-ced13f71-f46e-4522-b60e-cbadb5dc98f4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.002164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] The token cache is being invalidate because project 71dbc4d159d545de8c6ad3755085e26b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:41.002452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.003082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.004738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1018/1996] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:40 2022] DELETE /identity/v3/projects/71dbc4d159d545de8c6ad3755085e26b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:41.009125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.019015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6370c-d6a5-4e99-8697-9e31441ce810 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:41.038015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:41.082526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:41.083462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.083743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.084015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] PATH_INFO: `/v3/users/e7a8336af2814cbea974786856d91c76` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.085283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a8336af2814cbea974786856d91c76)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:41.087294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:41.138467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a8336af2814cbea974786856d91c76'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.145287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a8336af2814cbea974786856d91c76'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.152880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a8336af2814cbea974786856d91c76'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.164731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a8336af2814cbea974786856d91c76'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.165464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0668d929-a0df-4688-819e-a62e740e4878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a8336af2814cbea974786856d91c76'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.173207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 979/1997] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:41 2022] DELETE /identity/v3/users/e7a8336af2814cbea974786856d91c76 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:41.476284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.477760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:41.497273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced13f71-f46e-4522-b60e-cbadb5dc98f4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:41.554826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:41.555705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.555988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.556268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] PATH_INFO: `/v3/projects/c383d76f551b4424ba67556c3bbd2705` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.557507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c383d76f551b4424ba67556c3bbd2705)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:41.559421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:41.605475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c383d76f551b4424ba67556c3bbd2705', 'request_id': 'req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.611380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c383d76f551b4424ba67556c3bbd2705', 'request_id': 'req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.618436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c383d76f551b4424ba67556c3bbd2705', 'request_id': 'req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.623556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:41.639324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] The token cache is being invalidate because project c383d76f551b4424ba67556c3bbd2705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:41.639551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.640166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4e2485e2-a7d0-4fd6-b842-f7753b4f052b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:41.641789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1019/1998] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:41 2022] DELETE /identity/v3/projects/c383d76f551b4424ba67556c3bbd2705 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:41.646705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.646999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.647282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.665342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:41.666587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:41.728036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 980/1999] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:41.737326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.737621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.737922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.756872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:41.758124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:41.766545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1020/2000] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:41.770912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.780975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd3914-6eaf-4d42-aad3-892779b1d601 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:41.785591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:41.786241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.786526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.786802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.787524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:41.787827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:41.789432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:41.801520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 981/2001] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:41.805838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.817857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30a5b0-a551-477f-8bed-f0dc565eef7f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:41.822846 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:41.823553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.823827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.824103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.824797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:41.826817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:41.857241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1021/2002] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:41.861358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.873563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702441f-0a76-4bef-b643-001f9a5176b9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:41.905173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:41.941922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:41.942645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:41.942936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:41.943214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:41.943902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:41.945866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:41.967704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 982/2003] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:41 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:41.971907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:41.986995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9ed97-a2ec-4bd3-aa2c-ba91d7550b16 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.013398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.014237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.014432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.014791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.015580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.017333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.036310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1022/2004] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:42.040416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:42.060460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafbe83-173d-4c2d-939e-06ca082de2de admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.066397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.067453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.068944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.069231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.070019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.071685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93811617-e5a3-45a4-b9c9-7098d95fdd3a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.083567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 983/2005] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:42.087857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:42.103367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eca7d-325f-470b-9911-cbbac4c07fba admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.110081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.111008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.111291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.111588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] PATH_INFO: `/v3/projects/7f885b63f176454f970b702f220d99f1/users/b5094278d09d41fc85ad25d5e006749c/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.129026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f885b63f176454f970b702f220d99f1, user_id=b5094278d09d41fc85ad25d5e006749c, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.132297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.149373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1023/2006] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:42 2022] PUT /identity/v3/projects/7f885b63f176454f970b702f220d99f1/users/b5094278d09d41fc85ad25d5e006749c/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:42.162161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.162451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.162737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.195273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] MFA Rules not processed for user `b5094278d09d41fc85ad25d5e006749c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:42.199065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:42.279984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 984/2007] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:42.290284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:42.293080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:42.357655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d06cd-c0d0-4952-9384-1a44f706ae86 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.361324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.361974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.362250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.362524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.377219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.377219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3350-1095-4e78-bf53-1e24ea0ffa04 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.388354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1024/2008] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:42.394992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:42.397089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:42.483153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf6aee-ef90-4442-bfa5-d3647128a9d5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.488419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.489338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.489627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.489898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] PATH_INFO: `/v3/users/e9800d40c8d947e49992faa7613084b8` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.491105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9800d40c8d947e49992faa7613084b8)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.493440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.537551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:42.548589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9800d40c8d947e49992faa7613084b8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:42.558000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9800d40c8d947e49992faa7613084b8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:42.566653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9800d40c8d947e49992faa7613084b8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:42.583584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9800d40c8d947e49992faa7613084b8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:42.584331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9800d40c8d947e49992faa7613084b8'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:42.592085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 985/2009] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:42 2022] DELETE /identity/v3/users/e9800d40c8d947e49992faa7613084b8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:42.596652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.597122 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.597252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.616317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:42.617581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:42.687064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1025/2010] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:42.697986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:42.699597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:42.772494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fa50f-c8d1-4f3f-828f-10f2f98fe3f2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:42.776770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:42.777758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:42.778056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:42.778334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:42.787965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:42.789506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:42.799991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 986/2011] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:43.082543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:43.083979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:43.100839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810402a-f1be-42b2-a5a7-dbdcd733b912 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:43.116261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:43.117231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.117354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.117620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] PATH_INFO: `/v3/projects/b5dcbecabd5246ef8ceafbc71c8f7bfd` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.118815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dcbecabd5246ef8ceafbc71c8f7bfd)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:43.120774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:43.156945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:43.174808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dcbecabd5246ef8ceafbc71c8f7bfd', 'request_id': 'req-31748b76-f96c-46bb-b5d1-d8213ecc17e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.180313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dcbecabd5246ef8ceafbc71c8f7bfd', 'request_id': 'req-31748b76-f96c-46bb-b5d1-d8213ecc17e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.186686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dcbecabd5246ef8ceafbc71c8f7bfd', 'request_id': 'req-31748b76-f96c-46bb-b5d1-d8213ecc17e0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.205423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] The token cache is being invalidate because project b5dcbecabd5246ef8ceafbc71c8f7bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:43.205423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.205423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.205784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1026/2012] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:43 2022] DELETE /identity/v3/projects/b5dcbecabd5246ef8ceafbc71c8f7bfd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:43.209703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:43.227436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475524ab-1a4d-4597-ad42-1844ef6c51f2 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:43.288597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:43.289497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.289773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.290043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] PATH_INFO: `/v3/users/11b3527aa2ec45a0a0105c8307df171e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.291220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b3527aa2ec45a0a0105c8307df171e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:43.293571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:43.342783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b3527aa2ec45a0a0105c8307df171e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.350348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b3527aa2ec45a0a0105c8307df171e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.355366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:43.359023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b3527aa2ec45a0a0105c8307df171e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.372281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b3527aa2ec45a0a0105c8307df171e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.373250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f30fef7d-6402-4ffd-9871-f5d2258f3f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b3527aa2ec45a0a0105c8307df171e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.379349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 987/2013] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:43 2022] DELETE /identity/v3/users/11b3527aa2ec45a0a0105c8307df171e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:43.661941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:43.664023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:43.680524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748b76-f96c-46bb-b5d1-d8213ecc17e0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:43.743260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:43.744142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.744424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.744732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] PATH_INFO: `/v3/projects/f576972ef8d34f5aa45af6e6e7239013` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.745961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f576972ef8d34f5aa45af6e6e7239013)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:43.748136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:43.799897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f576972ef8d34f5aa45af6e6e7239013', 'request_id': 'req-c8ef367d-e4ee-41a1-934a-86893548967b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.806297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f576972ef8d34f5aa45af6e6e7239013', 'request_id': 'req-c8ef367d-e4ee-41a1-934a-86893548967b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.814038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f576972ef8d34f5aa45af6e6e7239013', 'request_id': 'req-c8ef367d-e4ee-41a1-934a-86893548967b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.827206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] The token cache is being invalidate because project f576972ef8d34f5aa45af6e6e7239013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:43.827508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.828158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c8ef367d-e4ee-41a1-934a-86893548967b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:43.829785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1027/2014] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:43 2022] DELETE /identity/v3/projects/f576972ef8d34f5aa45af6e6e7239013 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:43.834687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.834981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.835318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.858934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:43.860193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:43.928856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 988/2015] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:43.938029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.938321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.938605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.958707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:43.959954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:43.968465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1028/2016] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:43.972800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:43.984467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f3390-36a7-4e1e-98c9-272d6d0dee1d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:43.989350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:43.990007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:43.990287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:43.990560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:43.991277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:43.991578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:43.993162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.014022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 989/2017] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:44.018084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.028818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda30b1-db2d-40fe-a34c-0de910df6daa None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.035075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.035781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.036232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.036579 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.037365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.039304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.077828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1029/2018] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:44.082025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.093494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a692-62a1-42cc-9064-7a257fe24923 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.168961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.169719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.170034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.170358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.171264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.173203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.205066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 990/2019] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:44.208900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.221561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542d74-620b-4d57-9163-b730e639b70f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.226464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.227130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.227414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.227687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.228414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.230139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.244446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1030/2020] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:44.247283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.257809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863771b-1f3f-4c94-bc00-c475e8f7e810 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.263589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.264252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.264533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.264807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.265556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.267122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9dff8-f213-48e7-bae3-84530a15cd2c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.281915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 991/2021] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:44.283068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.295710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a70c-528f-49c2-beca-7c70da5fd0ee admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.301111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.302132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.302515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.302892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] PATH_INFO: `/v3/projects/3bc09f4fbbe04c47bf24503d0212d477/users/bf374b21507e474aa5ab0909b83ce8ee/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.308186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:44.323883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc09f4fbbe04c47bf24503d0212d477, user_id=bf374b21507e474aa5ab0909b83ce8ee, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.329250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.343857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1031/2022] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:44 2022] PUT /identity/v3/projects/3bc09f4fbbe04c47bf24503d0212d477/users/bf374b21507e474aa5ab0909b83ce8ee/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:44.358065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.358439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.358837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.390366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] MFA Rules not processed for user `bf374b21507e474aa5ab0909b83ce8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:44.391774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:44.430095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:44.474884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 992/2023] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:44.479637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.547631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325c10-cb72-46d8-bd8c-55dbd57a3d72 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.552328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.552994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.553345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.553625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.554319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.556355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.583517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1032/2024] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:44.587625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.599218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f05c-d84c-4327-81db-1f7d1351df8e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.658559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.659225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.659510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.659787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.660469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.662399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.683065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 993/2025] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:44.687181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.698511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cdbd-3ba4-4952-b7f9-95a48142eabb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.703852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.704548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.704835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.705106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.705881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.707541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.719556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1033/2026] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:44.723804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.734544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a3e0b-44cc-49d8-98db-b4c3aecb8a0a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.739740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.740582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.740872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.741563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] PATH_INFO: `/v3/projects/431c6e9fbba84b8baee1ed6408468ed2/users/ffff45a0054746e5bab4bb10f04ecf06/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.759213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431c6e9fbba84b8baee1ed6408468ed2, user_id=ffff45a0054746e5bab4bb10f04ecf06, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.762138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.777398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 994/2027] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:44 2022] PUT /identity/v3/projects/431c6e9fbba84b8baee1ed6408468ed2/users/ffff45a0054746e5bab4bb10f04ecf06/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:44.784032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.795922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734e89-c8e8-49b7-a702-f5f6e75137e7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.854548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.855231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.855513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.855787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.856540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.858176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447359ef-0c77-4ed8-b556-d8f85f56b17f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.868497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1034/2028] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:44.873688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:44.883891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866896-f617-45ab-ab15-90591960c6f2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:44.888478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:44.889382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.889666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.889943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] PATH_INFO: `/v3/projects/431c6e9fbba84b8baee1ed6408468ed2/users/ffff45a0054746e5bab4bb10f04ecf06/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.891907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] RBAC: Authorizing `identity:create_grant(project_id=431c6e9fbba84b8baee1ed6408468ed2, user_id=ffff45a0054746e5bab4bb10f04ecf06, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:44.894575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:44.905263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 995/2029] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:44 2022] PUT /identity/v3/projects/431c6e9fbba84b8baee1ed6408468ed2/users/ffff45a0054746e5bab4bb10f04ecf06/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:44.915594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:44.915877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:44.916155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:44.947243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] MFA Rules not processed for user `ffff45a0054746e5bab4bb10f04ecf06`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:44.948561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:44.993738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:45.019078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1035/2030] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:45.030745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:45.032450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:45.093265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a6a8-44e6-4db4-a31c-11cb0c80820b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:45.097925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:45.098578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:45.098862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:45.099136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:45.109408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:45.110854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:45.120983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 996/2031] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:45.166078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:45.167660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:45.179726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216ed34-c476-4349-99f1-7727ddf997e2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:45.183930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:45.184569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:45.184858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:45.185131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:45.244165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:45.246942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440e02f-7ec6-4c62-87d0-35d4d9a3a4f6 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:45.258950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1036/2032] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:45.473031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:45.474588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:45.539539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:45.609762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b4d1b-20f8-4981-ba7c-a509411f47f0 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:45.621952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:45.623108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:45.623419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:45.623660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] PATH_INFO: `/v3/users/b5094278d09d41fc85ad25d5e006749c` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:45.624896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5094278d09d41fc85ad25d5e006749c)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:45.626859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:45.684863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5094278d09d41fc85ad25d5e006749c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:45.692930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5094278d09d41fc85ad25d5e006749c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:45.701633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5094278d09d41fc85ad25d5e006749c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:45.714007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5094278d09d41fc85ad25d5e006749c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:45.714768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5094278d09d41fc85ad25d5e006749c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:45.722392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 997/2033] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:45 2022] DELETE /identity/v3/users/b5094278d09d41fc85ad25d5e006749c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:45.727420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:45.727981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:45.727981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:45.745378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:45.746575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:45.808048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1037/2034] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:45.817563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:45.818968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:45.879143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd2dda-f12a-4de9-b4f5-f36398c8bef6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:45.882810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:45.883468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:45.883752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:45.884029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:45.894042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:45.895471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4faf7-77ac-4967-aa60-5a556572891b service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:45.905036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 998/2035] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:46.209290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.210796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:46.225311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081a30c-0715-42ad-b4a0-455e9a8ff2a3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.230907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.231848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.232001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.232308 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] PATH_INFO: `/v3/projects/7f885b63f176454f970b702f220d99f1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.233660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f885b63f176454f970b702f220d99f1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.235688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.282870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f885b63f176454f970b702f220d99f1', 'request_id': 'req-ff8c6796-bac3-4893-93ae-9496503fcba9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:46.288241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f885b63f176454f970b702f220d99f1', 'request_id': 'req-ff8c6796-bac3-4893-93ae-9496503fcba9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:46.295005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f885b63f176454f970b702f220d99f1', 'request_id': 'req-ff8c6796-bac3-4893-93ae-9496503fcba9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:46.307698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] The token cache is being invalidate because project 7f885b63f176454f970b702f220d99f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:46.307988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:46.308627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ff8c6796-bac3-4893-93ae-9496503fcba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:46.310256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1038/2036] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:46 2022] DELETE /identity/v3/projects/7f885b63f176454f970b702f220d99f1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:46.315501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.315787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.316067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.333554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:46.334740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:46.387982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:46.405433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 999/2037] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:46.413956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.414239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.414515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.422178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:46.436623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:46.437856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:46.445612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1039/2038] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:46.449836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.460157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeef0ef-9ec0-47c9-b9d7-47fb35b195f4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.466502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.467193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.467484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.467762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.468501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:46.468811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.470466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.483655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1000/2039] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:46.488186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.497951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05022e9d-db56-4e0b-91d1-7d930d5497a2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.502495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.503296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.503571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.503838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.504542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.506453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.531959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1040/2040] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:46.536081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.546799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485a78-e1b5-4992-8f12-278c7e0269e6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.612859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.613576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.613864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.614144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.614843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.616749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.650116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1001/2041] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:46.652396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.663060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f7e8c-3891-4a3f-b06d-256c67a62cd6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.673607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.674379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.674731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.674924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.675751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.677971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.700793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1041/2042] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:46.705522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.718497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001d10-b947-4ff8-9ac6-5a18308cc50d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.723966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.724659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.724937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.725227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.725958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.727544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ac75e-bf49-4e88-a67c-6d90c7359ffb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.741863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1002/2043] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:46.747647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:46.780909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45687d58-ede0-4ca1-ba56-7512f840c11f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:46.794068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:46.795000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.795284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.795560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] PATH_INFO: `/v3/projects/0659f6071fc1480a81ff1b8797e5d7e1/users/bc97bf62a8eb4dde974c3704df6356ee/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.819078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0659f6071fc1480a81ff1b8797e5d7e1, user_id=bc97bf62a8eb4dde974c3704df6356ee, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:46.822317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:46.840845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1042/2044] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:46 2022] PUT /identity/v3/projects/0659f6071fc1480a81ff1b8797e5d7e1/users/bc97bf62a8eb4dde974c3704df6356ee/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:46.851038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:46.851552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:46.851934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:46.882086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] MFA Rules not processed for user `bc97bf62a8eb4dde974c3704df6356ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:46.883558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:46.972603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1003/2045] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:46.974077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.055532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de51ec-e57d-44ef-8f7a-c8f951d9776c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.062314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.063032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.063318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.063591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.064341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.066280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.106323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1043/2046] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:46 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:47.107322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.128098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae54ed8-fc56-41e8-8eac-4104fe99d295 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.183558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:47.202543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.203406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.203649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.204054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.204642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.207397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.232897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1004/2047] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:47 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:47.234405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.245928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d54d6c-eb4a-4e3e-b54c-985071b3378f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.250900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.251552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.251839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.252118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.252848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.254489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.267057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1044/2048] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:47.271883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.283577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc404-85af-4067-9a20-e9e875c68149 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.288961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.289678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.289962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.290265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.291020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.292785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e809-f105-4837-a46e-60dead96c2f0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.303489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1005/2049] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:47.309376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.319656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3bdf-a13f-47f4-8f83-5632c54fcff0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.325237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.326141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.326476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.326678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] PATH_INFO: `/v3/projects/161a695cb9b54061a6ba27bb78dfd320/users/332fb6443f77495b8ee1f7a39623b0ff/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.341761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] RBAC: Authorizing `identity:create_grant(project_id=161a695cb9b54061a6ba27bb78dfd320, user_id=332fb6443f77495b8ee1f7a39623b0ff, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.344340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.358669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1045/2050] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:47 2022] PUT /identity/v3/projects/161a695cb9b54061a6ba27bb78dfd320/users/332fb6443f77495b8ee1f7a39623b0ff/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:47.369307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.371038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.371338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.408093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] MFA Rules not processed for user `332fb6443f77495b8ee1f7a39623b0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:47.409446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:47.477784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1006/2051] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:47.482631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.535072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:47.550028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a65a52-e619-44c3-9e01-a0ff928a619e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.554709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.555370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.555660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.555949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.556635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.559228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.583564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1046/2052] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:47 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:47.587620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.598363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf4a0a-bb87-419e-86f1-6db3c643b188 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.671295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.672033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.672361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.672681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.673460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.675712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.695668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1007/2053] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:47 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:47.700515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.715921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366eeed-1242-48bb-af87-2c6d3c764574 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.720777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.721478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.721763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.722049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.722775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.724375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.740900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1047/2054] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:47.746089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.756593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229d05c-469c-4943-b42d-6479f9ea8fa8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.761460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.762341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.762623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.762899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] PATH_INFO: `/v3/projects/cb62cde506034e21b99ac6c4e7f4280d/users/e0effae6993a48dfb96e1e265dfa5f3d/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.778882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb62cde506034e21b99ac6c4e7f4280d, user_id=e0effae6993a48dfb96e1e265dfa5f3d, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.781045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.795553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1008/2055] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:47 2022] PUT /identity/v3/projects/cb62cde506034e21b99ac6c4e7f4280d/users/e0effae6993a48dfb96e1e265dfa5f3d/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:47.799882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.811828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401f957-dcee-4935-80a6-613cc99fed81 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.882913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.883665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.883989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.884306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.885207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.887350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c6a98c-c5ec-43c2-bd2e-c3e65d0ce646 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.900239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1048/2056] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:47.902565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:47.912807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b85e-6224-44ba-acfb-dd66b8eb2c48 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:47.919218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:47.920241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.920520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.920674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] PATH_INFO: `/v3/projects/cb62cde506034e21b99ac6c4e7f4280d/users/e0effae6993a48dfb96e1e265dfa5f3d/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:47.922751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb62cde506034e21b99ac6c4e7f4280d, user_id=e0effae6993a48dfb96e1e265dfa5f3d, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:47.925457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:47.937790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1009/2057] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:47 2022] PUT /identity/v3/projects/cb62cde506034e21b99ac6c4e7f4280d/users/e0effae6993a48dfb96e1e265dfa5f3d/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:47.948867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:47.949156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:47.949641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:48.000857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] MFA Rules not processed for user `e0effae6993a48dfb96e1e265dfa5f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:48.002259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:48.116363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1049/2058] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:48.123087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:48.125736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:48.134907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:48.199453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab711-b80a-41b9-b07e-64ed0f75bab2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:48.204555 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:48.205243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:48.205601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:48.205800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:48.270182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:48.272000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd09e5-ed78-4e63-8379-9c529b635463 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:48.283512 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1010/2059] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:48.732682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:48.734087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:48.781241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:48.801695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4d536-ad3c-48ed-8a60-43d5a12eafe8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:48.807084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:48.808566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:48.808854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:48.809131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] PATH_INFO: `/v3/users/bf374b21507e474aa5ab0909b83ce8ee` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:48.810478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf374b21507e474aa5ab0909b83ce8ee)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:48.812488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:48.860812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf374b21507e474aa5ab0909b83ce8ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:48.868131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf374b21507e474aa5ab0909b83ce8ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:48.876087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf374b21507e474aa5ab0909b83ce8ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:48.876733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf374b21507e474aa5ab0909b83ce8ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:48.889059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf374b21507e474aa5ab0909b83ce8ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:48.894889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1050/2060] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:48 2022] DELETE /identity/v3/users/bf374b21507e474aa5ab0909b83ce8ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:48.899411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:48.899867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:48.899975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:48.918188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:48.919383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:48.978116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1011/2061] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:48.988624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:48.990185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:49.052589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e62bb-1b9b-4458-aac3-2b868e0a35a0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:49.056433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:49.057133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:49.057133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:49.057697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:49.066944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:49.068360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:49.079214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1051/2062] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:49.532457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:49.533955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:49.548054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e323b7-9722-4d2c-af7c-36c97146d48a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:49.553298 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:49.554135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:49.554409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:49.554673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] PATH_INFO: `/v3/projects/3bc09f4fbbe04c47bf24503d0212d477` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:49.556255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc09f4fbbe04c47bf24503d0212d477)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:49.558935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:49.612072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc09f4fbbe04c47bf24503d0212d477', 'request_id': 'req-8fc28a58-208a-4df3-a638-8e49fe93d3ae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.616338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:49.619197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc09f4fbbe04c47bf24503d0212d477', 'request_id': 'req-8fc28a58-208a-4df3-a638-8e49fe93d3ae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.628783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc09f4fbbe04c47bf24503d0212d477', 'request_id': 'req-8fc28a58-208a-4df3-a638-8e49fe93d3ae'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.646235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] The token cache is being invalidate because project 3bc09f4fbbe04c47bf24503d0212d477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:49.646524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.647167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.648689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1012/2063] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:49 2022] DELETE /identity/v3/projects/3bc09f4fbbe04c47bf24503d0212d477 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:49.653096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:49.663004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4438e-9cea-47de-b282-6ee81dffdff4 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:49.724498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:49.725519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:49.725801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:49.726075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] PATH_INFO: `/v3/users/ffff45a0054746e5bab4bb10f04ecf06` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:49.727275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffff45a0054746e5bab4bb10f04ecf06)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:49.729288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:49.734771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:49.790463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffff45a0054746e5bab4bb10f04ecf06'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.798443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffff45a0054746e5bab4bb10f04ecf06'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.805879 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffff45a0054746e5bab4bb10f04ecf06'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.807533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffff45a0054746e5bab4bb10f04ecf06'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.812649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:49.814268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:49.827260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffff45a0054746e5bab4bb10f04ecf06'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:49.834355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1052/2064] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:49 2022] DELETE /identity/v3/users/ffff45a0054746e5bab4bb10f04ecf06 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:49.884365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28a58-208a-4df3-a638-8e49fe93d3ae admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:49.942103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:49.942762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:49.943043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:49.943322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:49.945080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.007438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.008884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f22be-4971-40d7-8a4a-8bb8886a34a5 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.019321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1013/2065] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:50.133546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.136483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.227909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630693db-6a14-49a1-934d-0a29e97a4a9d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.232718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.233642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.233899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.234177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] PATH_INFO: `/v3/projects/431c6e9fbba84b8baee1ed6408468ed2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.235374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431c6e9fbba84b8baee1ed6408468ed2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.237388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.288513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431c6e9fbba84b8baee1ed6408468ed2', 'request_id': 'req-4892753e-951f-441b-8869-8ccae5dcb8e2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:50.301613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431c6e9fbba84b8baee1ed6408468ed2', 'request_id': 'req-4892753e-951f-441b-8869-8ccae5dcb8e2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:50.309604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431c6e9fbba84b8baee1ed6408468ed2', 'request_id': 'req-4892753e-951f-441b-8869-8ccae5dcb8e2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:50.324606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] The token cache is being invalidate because project 431c6e9fbba84b8baee1ed6408468ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:50.324898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:50.326427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4892753e-951f-441b-8869-8ccae5dcb8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:50.328361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1053/2066] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:50 2022] DELETE /identity/v3/projects/431c6e9fbba84b8baee1ed6408468ed2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:50.333502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.333798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.334073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.352718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:50.354688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.419171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:50.439258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1014/2067] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:50.447309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.447662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.448358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.471090 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:50.472460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.482210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1054/2068] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:50.486924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.500439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b111b-a965-49c0-b364-a2ae107bded0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.505978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.506777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.507164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.507550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.508570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:50.509010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.511420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.530434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1015/2069] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:50.532312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.543433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ea83-5abf-45cd-a2f1-22ade201916a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.549002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.549704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.549997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.550276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.551092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.552927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.557991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:50.604995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1055/2070] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:50 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:50.609284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.621451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a588b-2b3e-408b-8849-5d2ebcc71a2a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.695667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.697571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.717836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.718783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.719187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.719559 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.721043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.723394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.751568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1016/2071] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:50 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:50.755284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.765630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc871ee-21ff-4059-88d7-759604635635 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.770879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.771015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.771255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.771533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.772255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.773883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.774634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ac8bf-2f1e-48e1-942f-eb9d7eb7730d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.779746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.780514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.780880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.781317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.787064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:50.791707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1017/2072] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:50.792566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.802889 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153945-8223-4b44-94b1-a2fcd7c85c38 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.807739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.808396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.808681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.808956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.809725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.811338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.822147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1018/2073] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:39:50.830259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:50.843909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc27be-5ce9-4adc-a718-fa04ee7a5593 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:50.849304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:50.862111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.862791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.862791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] PATH_INFO: `/v3/projects/c47501a334894237b358a68ef2e91a2a/users/f1bdbe08104e4b1d8cb4265b9d35c78a/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.871018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.872780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f1355-cde5-494a-ade3-30b0983fb57a service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.887995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1056/2074] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:50.889903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47501a334894237b358a68ef2e91a2a, user_id=f1bdbe08104e4b1d8cb4265b9d35c78a, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:50.892972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:50.920839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1019/2075] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:50 2022] PUT /identity/v3/projects/c47501a334894237b358a68ef2e91a2a/users/f1bdbe08104e4b1d8cb4265b9d35c78a/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:50.931522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:50.932370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:50.932667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:50.971267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] MFA Rules not processed for user `f1bdbe08104e4b1d8cb4265b9d35c78a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:50.972502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:51.041774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1057/2076] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:51.046312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.109074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb68f8-1d92-4ca7-856a-0d0898b8692c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.115580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.116679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.116962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.117292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.118072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.120911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.147943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1020/2077] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:51 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:51.152360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.164370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb92ade-b19d-41c3-8127-99fad79d9baf None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.189937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:51.224683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.225429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.225856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.226169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.227020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.229241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.250010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1058/2078] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:51 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:51.254281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.265517 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26172ad8-b44d-44e6-be81-721c13eef744 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.270497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.271167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.271441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.271773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.272577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.274479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.277616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:51.288489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1021/2079] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:51.294776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.304876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47dd5e-2047-4c5a-8109-156687f0480e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.310421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.311301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.311578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.311849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] PATH_INFO: `/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd/users/fd32a447d81f4dd3bd517569f899d138/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.327777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d658327c3c6419c9ad30a8e62ccebcd, user_id=fd32a447d81f4dd3bd517569f899d138, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.330470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.343103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1059/2080] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:51 2022] PUT /identity/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd/users/fd32a447d81f4dd3bd517569f899d138/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:51.347074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.358255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e477a-817f-4ba8-ab4f-20fe0e663a13 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.435737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.436582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.436990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.437427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.438600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.440730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834181-c686-4728-a059-45852c965c7b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.459605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1022/2081] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:51.460546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.470904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caf4ee-5e2a-4285-9a28-5fce647538e2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.475810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.476695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.476979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.477288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] PATH_INFO: `/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd/users/fd32a447d81f4dd3bd517569f899d138/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.479993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d658327c3c6419c9ad30a8e62ccebcd, user_id=fd32a447d81f4dd3bd517569f899d138, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.482603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.493267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1060/2082] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:51 2022] PUT /identity/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd/users/fd32a447d81f4dd3bd517569f899d138/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:51.505859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.506207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.506521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.535832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] MFA Rules not processed for user `fd32a447d81f4dd3bd517569f899d138`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:51.537087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:51.617221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1023/2083] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:51.628623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:51.630570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:51.704343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be37f3-532e-4d02-ba96-e77ff71c5d09 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:51.708175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:51.708830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:51.709371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:51.709659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:51.722675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:51.724133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bb5ba-d310-4efa-873b-7c11fbf7d695 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:51.735359 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1061/2084] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:52.638738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:52.700188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb657a25-906d-4764-a8ae-d89877907fdf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:52.704801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:52.705706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:52.705991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:52.706262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] PATH_INFO: `/v3/users/f1bdbe08104e4b1d8cb4265b9d35c78a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:52.707484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bdbe08104e4b1d8cb4265b9d35c78a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:52.709468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:52.733112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:52.758253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bdbe08104e4b1d8cb4265b9d35c78a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:52.766128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bdbe08104e4b1d8cb4265b9d35c78a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:52.773046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bdbe08104e4b1d8cb4265b9d35c78a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:52.785943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bdbe08104e4b1d8cb4265b9d35c78a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:52.786714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bdbe08104e4b1d8cb4265b9d35c78a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:52.794201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1024/2085] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:52 2022] DELETE /identity/v3/users/f1bdbe08104e4b1d8cb4265b9d35c78a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:52.798759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:52.799254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:52.799436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:52.818394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:52.819595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:52.888487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1062/2086] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:52.898821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:52.900243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:52.985859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43801b53-cbeb-4c60-8ac9-02bab507d76c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:52.990876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:52.991814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:52.992324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:52.992756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:53.021719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:53.023272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:53.035103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1025/2087] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:53.478378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:53.481072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:53.495065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568edd4b-08ab-49e8-8908-977aab44ff9c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:53.509387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:53.509387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:53.509387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:53.509387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] PATH_INFO: `/v3/projects/c47501a334894237b358a68ef2e91a2a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:53.509902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47501a334894237b358a68ef2e91a2a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:53.509902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:53.546060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:53.593126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47501a334894237b358a68ef2e91a2a', 'request_id': 'req-b013f48d-237e-4099-b1df-f8799bf9e272'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.601633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47501a334894237b358a68ef2e91a2a', 'request_id': 'req-b013f48d-237e-4099-b1df-f8799bf9e272'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.609206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47501a334894237b358a68ef2e91a2a', 'request_id': 'req-b013f48d-237e-4099-b1df-f8799bf9e272'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.626008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] The token cache is being invalidate because project c47501a334894237b358a68ef2e91a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:53.626289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.628412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.629215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1063/2088] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:53 2022] DELETE /identity/v3/projects/c47501a334894237b358a68ef2e91a2a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:53.633172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:53.649644 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7467e-008b-446f-beb1-486b6cf0ad7c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:53.738065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:53.739327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:53.740137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:53.740396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] PATH_INFO: `/v3/users/fd32a447d81f4dd3bd517569f899d138` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:53.742046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd32a447d81f4dd3bd517569f899d138)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:53.743966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:53.796824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:53.799703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd32a447d81f4dd3bd517569f899d138'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.809881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd32a447d81f4dd3bd517569f899d138'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.817322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd32a447d81f4dd3bd517569f899d138'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.831067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd32a447d81f4dd3bd517569f899d138'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.832565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-569a5889-355f-4b7b-ac8b-d89ceec6d7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd32a447d81f4dd3bd517569f899d138'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:53.839776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1026/2089] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:53 2022] DELETE /identity/v3/users/fd32a447d81f4dd3bd517569f899d138 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:54.139366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.141126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:54.155447 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f48d-237e-4099-b1df-f8799bf9e272 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.231713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.232586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.232866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.233140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] PATH_INFO: `/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.234389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d658327c3c6419c9ad30a8e62ccebcd)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.236304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.313646 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d658327c3c6419c9ad30a8e62ccebcd', 'request_id': 'req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:54.328824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d658327c3c6419c9ad30a8e62ccebcd', 'request_id': 'req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:54.336121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d658327c3c6419c9ad30a8e62ccebcd', 'request_id': 'req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:54.360455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] The token cache is being invalidate because project 5d658327c3c6419c9ad30a8e62ccebcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:54.360883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:54.361697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8f331ddc-bc75-4ff2-87cf-762bcbcf7d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:54.368839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1064/2090] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:54 2022] DELETE /identity/v3/projects/5d658327c3c6419c9ad30a8e62ccebcd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:54.371592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.371886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.372538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.412140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:54.413393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:54.512456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1027/2091] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:54.519997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.520361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.522165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.546762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:54.548067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:54.556300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1065/2092] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:54.561145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.571624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35291fdf-6c7e-42f4-b287-7da757342ce2 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.576545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.577369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.577652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.577997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.578932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:54.579313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.581002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.605238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1028/2093] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:54.609831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.623752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78c94-1127-4915-bb59-20d5a9d0a8b4 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.629838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.630923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.631388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.632071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.633753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.636112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.669759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1066/2094] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:54 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:54.673851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.689142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac15ba-4f92-4267-a331-80c7598fdaeb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.760488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.761317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.761672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.761956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.762786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.765226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.790695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1029/2095] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:54 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:54.792939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.803624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bfb16-e87f-4edb-916e-3d4089224673 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.809314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.809980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.810262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.810541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.811328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.812872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.814222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:54.829518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1067/2096] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:54.831270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.842125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557f9e0-0620-43eb-ac8f-add20cd63db6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.847733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.848389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.848675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.848951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.849717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.851527 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3d79-56aa-4b23-917b-017c81adc45f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.862702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1030/2097] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:54.867098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.878730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654a73d-5f00-431c-8b6a-5d389e076bdb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:54.883469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:54.884425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.884814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.885159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] PATH_INFO: `/v3/projects/b6facc9f9abb47849f201b2a24f2e109/users/6abe1dc3b9924178ac2f4f17480d3fc0/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.911599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6facc9f9abb47849f201b2a24f2e109, user_id=6abe1dc3b9924178ac2f4f17480d3fc0, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:54.914701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:54.935758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1068/2098] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:54 2022] PUT /identity/v3/projects/b6facc9f9abb47849f201b2a24f2e109/users/6abe1dc3b9924178ac2f4f17480d3fc0/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:54.946274 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:54.946593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:54.946871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:54.990767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:54.992660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.004735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] MFA Rules not processed for user `6abe1dc3b9924178ac2f4f17480d3fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:55.006040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.032547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:55.089856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff1cf8-6356-4d43-95c4-76f689b67bd8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.095512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.096731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.097281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.098004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] PATH_INFO: `/v3/users/bc97bf62a8eb4dde974c3704df6356ee` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.099131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1031/2099] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:55.099996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc97bf62a8eb4dde974c3704df6356ee)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.102181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.103683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.114499 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159ec6-f563-4821-a2cc-43b7ba99c487 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.120024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.120685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.120967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.121267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.121955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.124157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.149541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1032/2100] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:55.154944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.159880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc97bf62a8eb4dde974c3704df6356ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.168999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc97bf62a8eb4dde974c3704df6356ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.176392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc97bf62a8eb4dde974c3704df6356ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.177056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc97bf62a8eb4dde974c3704df6356ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.189580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-23c9da4e-b3f9-463f-b455-9b95309fca32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc97bf62a8eb4dde974c3704df6356ee'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.196229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1069/2101] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:54 2022] DELETE /identity/v3/users/bc97bf62a8eb4dde974c3704df6356ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:55.200643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.200933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.201244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.218482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:55.219389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a6ea-d98d-43c5-9a98-25bdd78c69b3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.219705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.270877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:55.283238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.284182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.284528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.284862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.285598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.287556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.290450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1070/2102] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:55.300263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.301681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.308210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1033/2103] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:55 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:55.313146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.314933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.327446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865e4fe-3976-4a24-bcc8-bb97741ff3da admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.332775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.333692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.333976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.334253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.334984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.336720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.351167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1034/2104] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:55.352116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.362226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed01a6-59f6-4529-8fcd-1a6ac7a69d70 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.365995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990beff-2d0c-42aa-a469-f9a7312bda2f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.367804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.368946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.369500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.370154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.370273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] PATH_INFO: `/v3/projects/244f939beb1144a9958f21d54e6d8a95/users/2e65bfa2cc9b48ac9052857ac638f578/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.370481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.370706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.370973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.381386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.382825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.388463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244f939beb1144a9958f21d54e6d8a95, user_id=2e65bfa2cc9b48ac9052857ac638f578, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.391154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.394276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:55.395190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1071/2105] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:55.408379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1035/2106] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:55 2022] PUT /identity/v3/projects/244f939beb1144a9958f21d54e6d8a95/users/2e65bfa2cc9b48ac9052857ac638f578/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:55.412595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.422575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4690d-f38a-4ad0-837a-0c38be7281d1 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.488837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.489571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.489876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.490152 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.490873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.492460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e30319-e971-4ad5-8b0c-e345279567b3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.503876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1072/2107] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:55.508038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.520325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7c8a2-b7a2-4d43-b242-2469957da7a9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.525894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.526858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.527139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.527409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] PATH_INFO: `/v3/projects/244f939beb1144a9958f21d54e6d8a95/users/2e65bfa2cc9b48ac9052857ac638f578/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.529450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=244f939beb1144a9958f21d54e6d8a95, user_id=2e65bfa2cc9b48ac9052857ac638f578, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.532144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.542824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1036/2108] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:55 2022] PUT /identity/v3/projects/244f939beb1144a9958f21d54e6d8a95/users/2e65bfa2cc9b48ac9052857ac638f578/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:55.554826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.555510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.555510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.577794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.579626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.589993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] MFA Rules not processed for user `2e65bfa2cc9b48ac9052857ac638f578`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:55.592137 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.672408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e55b9-67c4-4b8d-aba5-ef2cf67fe08f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.679726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.680876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.681277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.682179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] PATH_INFO: `/v3/users/010c73a8a43d42fb83272760952b80e6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.683733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010c73a8a43d42fb83272760952b80e6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.685790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.689634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1073/2109] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:55.696865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.699869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.737446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:55.751363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010c73a8a43d42fb83272760952b80e6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.764713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010c73a8a43d42fb83272760952b80e6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.774315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010c73a8a43d42fb83272760952b80e6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.792110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010c73a8a43d42fb83272760952b80e6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.792298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba662f-8149-4842-91a0-320893ccebd7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.793212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010c73a8a43d42fb83272760952b80e6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:55.796792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.797563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.797851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.798126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.799951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.807653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1037/2110] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:55 2022] DELETE /identity/v3/users/010c73a8a43d42fb83272760952b80e6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:55.808846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.810622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.815774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.818509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2d7ba-0612-4620-b2af-b7ef02b5cd93 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.836034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1074/2111] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:55.837171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.837171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.837171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.866001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:55.867477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:55.923035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3956cb-df2a-4097-a1c4-1074ca21f2a2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:55.929084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:55.930363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:55.930798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:55.931222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] PATH_INFO: `/v3/projects/0659f6071fc1480a81ff1b8797e5d7e1` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:55.934850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0659f6071fc1480a81ff1b8797e5d7e1)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:55.959645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1075/2112] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:55.959789 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:55.961653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:55.968136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:55.970495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.038232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0659f6071fc1480a81ff1b8797e5d7e1', 'request_id': 'req-58049053-8a0c-4523-8d96-3b31f37abda0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.045219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0659f6071fc1480a81ff1b8797e5d7e1', 'request_id': 'req-58049053-8a0c-4523-8d96-3b31f37abda0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.055940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0659f6071fc1480a81ff1b8797e5d7e1', 'request_id': 'req-58049053-8a0c-4523-8d96-3b31f37abda0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.076688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a1a54-cb5c-40d4-9bae-7c2bacfadb33 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:56.077051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] The token cache is being invalidate because project 0659f6071fc1480a81ff1b8797e5d7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:56.077424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.078175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.079779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1038/2113] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:55 2022] DELETE /identity/v3/projects/0659f6071fc1480a81ff1b8797e5d7e1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:56.086037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:56.089858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.191813 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:56.192482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:56.192930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:56.193243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:56.195134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.211168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049053-8a0c-4523-8d96-3b31f37abda0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:56.225234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:56.227871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:56.228228 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:56.231006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] PATH_INFO: `/v3/users/332fb6443f77495b8ee1f7a39623b0ff` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:56.234382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332fb6443f77495b8ee1f7a39623b0ff)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:56.238328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:56.247628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:56.319002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:56.320985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:56.334013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332fb6443f77495b8ee1f7a39623b0ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.335821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1076/2114] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:39:56.346297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332fb6443f77495b8ee1f7a39623b0ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.358953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332fb6443f77495b8ee1f7a39623b0ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.390672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332fb6443f77495b8ee1f7a39623b0ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.390672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1616d678-a25b-4163-a4ed-ec59ae50f2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332fb6443f77495b8ee1f7a39623b0ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.408987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1039/2115] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:56 2022] DELETE /identity/v3/users/332fb6443f77495b8ee1f7a39623b0ff => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:56.429020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:56.430691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.448757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a1db3-5aa9-4d16-ba09-e83ad44fa5fc service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:56.528210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:56.529216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:56.529849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:56.529849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] PATH_INFO: `/v3/users/6abe1dc3b9924178ac2f4f17480d3fc0` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:56.532677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abe1dc3b9924178ac2f4f17480d3fc0)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:56.534319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:56.602726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abe1dc3b9924178ac2f4f17480d3fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.624404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abe1dc3b9924178ac2f4f17480d3fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.649855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abe1dc3b9924178ac2f4f17480d3fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.651400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abe1dc3b9924178ac2f4f17480d3fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.668436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abe1dc3b9924178ac2f4f17480d3fc0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:56.676696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1077/2116] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:56 2022] DELETE /identity/v3/users/6abe1dc3b9924178ac2f4f17480d3fc0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:56.683030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:56.684111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:56.685135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:56.711349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:56.712560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.722510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:56.810935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1040/2117] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:56.826698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:56.828143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:56.890093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:56.908013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b33696-efcc-4ebf-a7d0-9e3861efcb67 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:56.914330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:56.915469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:56.915767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:56.916317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:56.933648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:56.935974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b066b-19f8-4562-8317-78700935dca0 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:56.948941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1078/2118] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:57.062781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.064904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.079509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49412edc-c807-4c50-98ec-d6498e6a954c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.085373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.086448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.086781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.087059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] PATH_INFO: `/v3/projects/3e497a5781234c82973af110a8faab1e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.089442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e497a5781234c82973af110a8faab1e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.091425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.152388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e497a5781234c82973af110a8faab1e', 'request_id': 'req-57188d72-062e-414e-a608-7cdfde33ca6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.159312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e497a5781234c82973af110a8faab1e', 'request_id': 'req-57188d72-062e-414e-a608-7cdfde33ca6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.170602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e497a5781234c82973af110a8faab1e', 'request_id': 'req-57188d72-062e-414e-a608-7cdfde33ca6d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.191076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] The token cache is being invalidate because project 3e497a5781234c82973af110a8faab1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:57.191592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.192666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.196175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1041/2119] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:57 2022] DELETE /identity/v3/projects/3e497a5781234c82973af110a8faab1e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:57.203742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6468f2-eaa2-43c2-960b-31d4677851db None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.204522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6468f2-eaa2-43c2-960b-31d4677851db None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.204686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6468f2-eaa2-43c2-960b-31d4677851db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.228377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3e6468f2-eaa2-43c2-960b-31d4677851db None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:57.230315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e6468f2-eaa2-43c2-960b-31d4677851db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.246688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.254066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.309161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1079/2120] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:57.318867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.319184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.319436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.343029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:57.344196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.359911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1080/2121] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:39:57.360840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.372527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93089147-a996-495d-8fcb-d9e2256492bd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.378787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.379459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.380133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.380419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.381175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:57.381490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.383129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.399111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1081/2122] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:57.404209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.412049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57188d72-062e-414e-a608-7cdfde33ca6d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.414788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aeae7-06e3-470d-a1c6-9f34abe41702 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.425127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.425885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.426199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.426432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.427260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.429246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.433269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.435024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.435651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.436135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] PATH_INFO: `/v3/projects/161a695cb9b54061a6ba27bb78dfd320` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.437852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] RBAC: Authorizing `identity:delete_project(project_id=161a695cb9b54061a6ba27bb78dfd320)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.440049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.486186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1082/2123] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:57 2022] POST /identity/v3/projects => generated 361 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:57.487239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.488888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.500917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:57.514676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161a695cb9b54061a6ba27bb78dfd320', 'request_id': 'req-2306be08-d56f-45e5-aa33-2f78cc94373c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.528338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161a695cb9b54061a6ba27bb78dfd320', 'request_id': 'req-2306be08-d56f-45e5-aa33-2f78cc94373c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.538098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161a695cb9b54061a6ba27bb78dfd320', 'request_id': 'req-2306be08-d56f-45e5-aa33-2f78cc94373c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.554520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] The token cache is being invalidate because project 161a695cb9b54061a6ba27bb78dfd320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:57.555571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.556239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.558780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1042/2124] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:57 2022] DELETE /identity/v3/projects/161a695cb9b54061a6ba27bb78dfd320 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:57.559680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.561148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.582430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709b4d-d8f7-453d-aab7-ede651c32950 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.648682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:57.658399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306be08-d56f-45e5-aa33-2f78cc94373c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.663591 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.663827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.664390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.664498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.664673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.664784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.664952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.665052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] PATH_INFO: `/v3/projects/b6facc9f9abb47849f201b2a24f2e109` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.665694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.666715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6facc9f9abb47849f201b2a24f2e109)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.668432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.668953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.703604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1043/2125] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:57 2022] POST /identity/v3/users => generated 281 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:57.703604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.704217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.721929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd296b1-9199-409b-a121-664f0443b84f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.744343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6facc9f9abb47849f201b2a24f2e109', 'request_id': 'req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.754963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6facc9f9abb47849f201b2a24f2e109', 'request_id': 'req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.766480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6facc9f9abb47849f201b2a24f2e109', 'request_id': 'req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.798109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.799737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.800240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.800658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] PATH_INFO: `/v3/users/e0effae6993a48dfb96e1e265dfa5f3d` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.801623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] The token cache is being invalidate because project b6facc9f9abb47849f201b2a24f2e109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:57.802181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.802747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0effae6993a48dfb96e1e265dfa5f3d)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.803050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.808937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1083/2126] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:57 2022] DELETE /identity/v3/projects/b6facc9f9abb47849f201b2a24f2e109 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:57.808937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.810157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.811264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.829271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20ff4d-8665-40b6-a3c5-76ba352b70ad admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.837207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.839238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.839238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.839787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.840781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.843124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.875776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1084/2127] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:57.877220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.879323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.897713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0effae6993a48dfb96e1e265dfa5f3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.906925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c0154-4ddb-4681-a8ef-8110d015eb09 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:57.909934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0effae6993a48dfb96e1e265dfa5f3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.911850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:57.912741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:57.913011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:57.913217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:57.913337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] PATH_INFO: `/v3/users/2e65bfa2cc9b48ac9052857ac638f578` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:57.914850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e65bfa2cc9b48ac9052857ac638f578)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:57.918055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:57.920682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0effae6993a48dfb96e1e265dfa5f3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.939009 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0effae6993a48dfb96e1e265dfa5f3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.939902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0effae6993a48dfb96e1e265dfa5f3d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:57.946519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1044/2128] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:57 2022] DELETE /identity/v3/users/e0effae6993a48dfb96e1e265dfa5f3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:57.947671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:57.958296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:57.998925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e65bfa2cc9b48ac9052857ac638f578'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.011509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e65bfa2cc9b48ac9052857ac638f578'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.029954 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e65bfa2cc9b48ac9052857ac638f578'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.031632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e65bfa2cc9b48ac9052857ac638f578'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.052905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e65bfa2cc9b48ac9052857ac638f578'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.062738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1085/2129] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:57 2022] DELETE /identity/v3/users/2e65bfa2cc9b48ac9052857ac638f578 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:58.073747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fa882-958f-4350-926e-d10e2e906e91 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.170816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.171285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.171845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.171845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.172709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.174554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae3bac-9ab1-4142-893b-e7d4bdefa82b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.209446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1045/2130] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:58.223320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:58.230908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.248854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95b2ef-922a-4c15-833c-382b6f1e6ead admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.258195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.261425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.261904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.262330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] PATH_INFO: `/v3/projects/02c1ca9321574ffdb253e90cef514d93/users/78a0ae8a64714fd489bc1337d2d18be8/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.282663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c1ca9321574ffdb253e90cef514d93, user_id=78a0ae8a64714fd489bc1337d2d18be8, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.285575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.300857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1086/2131] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:58 2022] PUT /identity/v3/projects/02c1ca9321574ffdb253e90cef514d93/users/78a0ae8a64714fd489bc1337d2d18be8/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:58.313582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.314144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.314511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.346933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] MFA Rules not processed for user `78a0ae8a64714fd489bc1337d2d18be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:58.348156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.418157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:58.422512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.467294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1046/2132] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:58.476691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:58.512543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:58.514255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.540753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:58.557955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ef188-2dd8-4026-a56c-de3abade806a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.563853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.564969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.565345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.565693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] PATH_INFO: `/v3/projects/cb62cde506034e21b99ac6c4e7f4280d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.567098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb62cde506034e21b99ac6c4e7f4280d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.570741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.609253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7dc110-2a68-4d1c-9806-d49eb362a66d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.615684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.616428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.616704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.617095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.629166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.630859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.644374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1047/2133] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:58.655218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:58.657340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.670323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb62cde506034e21b99ac6c4e7f4280d', 'request_id': 'req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.678293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ce887-c408-4312-805f-d8526713a3eb service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.679419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb62cde506034e21b99ac6c4e7f4280d', 'request_id': 'req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.688908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb62cde506034e21b99ac6c4e7f4280d', 'request_id': 'req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.712323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] The token cache is being invalidate because project cb62cde506034e21b99ac6c4e7f4280d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:58.712662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.713556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.719906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1087/2134] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:58 2022] DELETE /identity/v3/projects/cb62cde506034e21b99ac6c4e7f4280d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:39:58.719906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:58.719906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.759625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.761104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.761422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.761691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] PATH_INFO: `/v3/projects/244f939beb1144a9958f21d54e6d8a95` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.762943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244f939beb1144a9958f21d54e6d8a95)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.764872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.804332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9269-6318-4ef4-bf0c-cd01a4c60b6e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:58.810250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:58.811517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.811796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.812649 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] PATH_INFO: `/v3/users/78a0ae8a64714fd489bc1337d2d18be8` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.813830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a0ae8a64714fd489bc1337d2d18be8)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:58.816145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:58.829346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244f939beb1144a9958f21d54e6d8a95', 'request_id': 'req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.838660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244f939beb1144a9958f21d54e6d8a95', 'request_id': 'req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.851311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244f939beb1144a9958f21d54e6d8a95', 'request_id': 'req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.869258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] The token cache is being invalidate because project 244f939beb1144a9958f21d54e6d8a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:58.869762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.871292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d72bc54-f1a9-479b-8b47-a4b1259db0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.873539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1048/2135] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:58 2022] DELETE /identity/v3/projects/244f939beb1144a9958f21d54e6d8a95 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:58.874997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4a5d-928b-4bde-9a77-62c9181eb103 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.875382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4a5d-928b-4bde-9a77-62c9181eb103 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.875685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b4a5d-928b-4bde-9a77-62c9181eb103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.883013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a0ae8a64714fd489bc1337d2d18be8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.888574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:58.895212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a0ae8a64714fd489bc1337d2d18be8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.904365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-316b4a5d-928b-4bde-9a77-62c9181eb103 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:58.906408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-316b4a5d-928b-4bde-9a77-62c9181eb103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.913494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a0ae8a64714fd489bc1337d2d18be8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.916380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a0ae8a64714fd489bc1337d2d18be8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.930671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-04a31ff2-140a-49b2-90a9-000cece983ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a0ae8a64714fd489bc1337d2d18be8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:58.941493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1088/2136] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:39:58 2022] DELETE /identity/v3/users/78a0ae8a64714fd489bc1337d2d18be8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:58.941493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c3f7-852a-4d9f-af14-22e80bb7804f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:58.941493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c3f7-852a-4d9f-af14-22e80bb7804f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:58.941828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c3f7-852a-4d9f-af14-22e80bb7804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:58.962263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ad13c3f7-852a-4d9f-af14-22e80bb7804f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:58.964162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ad13c3f7-852a-4d9f-af14-22e80bb7804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:58.971611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:59.014932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1049/2137] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.016213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.016509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.016786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.037162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:59.038428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.051452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1089/2138] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.053254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493f88-3f11-4b13-a1eb-b31b41ed2629 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.054085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493f88-3f11-4b13-a1eb-b31b41ed2629 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.054478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd493f88-3f11-4b13-a1eb-b31b41ed2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.086058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-fd493f88-3f11-4b13-a1eb-b31b41ed2629 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:59.088506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fd493f88-3f11-4b13-a1eb-b31b41ed2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.108654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1090/2139] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.111968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.111968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.111968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.127443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1050/2140] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.128663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.131112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:59.132512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.141832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c46fcc-7fc6-46c9-9746-91197cb3ebcb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.146651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1091/2141] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.148042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.151098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.151695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.151952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.152379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.153398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:59.153906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.154030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.155962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.169619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1051/2142] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:59.173984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.192195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408064c2-840f-49df-a660-d9d1efe93e53 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.197516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.198198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.198482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.199314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.200053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:39:59.200361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.202536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.217285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1052/2143] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:39:59.221203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.231488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a005118-645c-4ec6-b915-39f02c7b8957 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.236093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679e45-cdd4-44fb-a4cf-f6ab2ee1ed76 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.238340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.239544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.240057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.240346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.240451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.241055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.241165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.241496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.241844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.243151 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.253124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.254718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.274029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1053/2144] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:59.274957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.281355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1092/2145] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:39:59.282902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.294865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68372-bdff-47d8-8c38-9c0ea3ab51db service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.356785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5986-ed0c-4b71-8b06-5982ef8ed9c7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.363169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.363796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.364326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.364843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.365900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.368331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.389237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.390476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.390960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.392239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.393348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.396804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.406704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:59.410186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1054/2146] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:59.411424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.426888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1093/2147] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:39:59.431220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.435697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:59.443575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efbc11-77ee-4f25-b0f7-b1a006f6ee26 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.493077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ee07-ec95-472c-8387-0e12b4cc4e3b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.504822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.505542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.505826 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.506884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.507247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.509399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.537732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.538478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.538881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.539115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.539870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.543140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.578120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1055/2148] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:39:59.579281 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.583621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1094/2149] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:59.584789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.593001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5d45-e8a2-43aa-8e98-f7dc90148a1e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.598266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.598937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.605939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.605939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.606271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2007ff-c728-4086-a8b7-668043ee2d42 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.606358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.606358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.609423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.610197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.611002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.611602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.613395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.615552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.624508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1056/2150] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:59.625942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.637673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1095/2151] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:59.638922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.648692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71737b1-8dfa-4deb-9dc8-217ac39f11be admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.656806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ab83-c901-4109-8a63-93a603128098 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.660825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.662295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.662894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.664161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.664657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.665629 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.666454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.666680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.667442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] PATH_INFO: `/v3/projects/7d0e39331e1e42b8b671d84747ec9255/users/ccf36446834f4597a46ea1289e06bd44/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.673585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.688631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0e39331e1e42b8b671d84747ec9255, user_id=ccf36446834f4597a46ea1289e06bd44, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.691708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.703471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1057/2152] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:39:59.703471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.705891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.709654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1096/2153] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:59 2022] PUT /identity/v3/projects/7d0e39331e1e42b8b671d84747ec9255/users/ccf36446834f4597a46ea1289e06bd44/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:59.713258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:39:59.739560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a1e6a-e300-463a-8be8-3f391028c9b2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.808186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26f94-2d79-43ad-bafd-358999efd6ea admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:39:59.810342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.811490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.811780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.812120 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] PATH_INFO: `/v3/projects/02c1ca9321574ffdb253e90cef514d93` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.813363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:39:59.813494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c1ca9321574ffdb253e90cef514d93)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.814345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.814693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.815045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] PATH_INFO: `/v3/projects/589ae904ad7246af967e452db5e82919/users/a1590be76bf640e69581d5477abf62a3/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.815421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.830836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] RBAC: Authorizing `identity:create_grant(project_id=589ae904ad7246af967e452db5e82919, user_id=a1590be76bf640e69581d5477abf62a3, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:39:59.833681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a33ca-8d4a-4395-8e69-6bbe0b95184e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:39:59.856285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1097/2154] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:39:59 2022] PUT /identity/v3/projects/589ae904ad7246af967e452db5e82919/users/a1590be76bf640e69581d5477abf62a3/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:59.856285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899ad-e4ac-45ce-8931-5eaba44b5894 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.856285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899ad-e4ac-45ce-8931-5eaba44b5894 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.856285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea899ad-e4ac-45ce-8931-5eaba44b5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.881135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c1ca9321574ffdb253e90cef514d93', 'request_id': 'req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:59.888453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c1ca9321574ffdb253e90cef514d93', 'request_id': 'req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:59.890880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2ea899ad-e4ac-45ce-8931-5eaba44b5894 None None] MFA Rules not processed for user `ccf36446834f4597a46ea1289e06bd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:59.892089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2ea899ad-e4ac-45ce-8931-5eaba44b5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.897892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c1ca9321574ffdb253e90cef514d93', 'request_id': 'req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:59.914827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] The token cache is being invalidate because project 02c1ca9321574ffdb253e90cef514d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:39:59.914827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:59.915542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-3d2770d5-dd31-442e-af4a-a3265bc8d1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:39:59.917320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:59.917735 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1058/2155] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:39:59 2022] DELETE /identity/v3/projects/02c1ca9321574ffdb253e90cef514d93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:39:59.919150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.919578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.919921 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:39:59.949927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] MFA Rules not processed for user `a1590be76bf640e69581d5477abf62a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:39:59.952185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:39:59.959210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:39:59.982589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1098/2156] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:39:59.984086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:39:59.984381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:39:59.984658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.021147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:00.022444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:00.064327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1059/2157] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:00.067901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.067901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:00.106956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1099/2158] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:00.113462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.114814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:00.130500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb978ad-f81b-41b7-9767-f9237ce442d6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.135839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.136634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.136995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.137368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.137793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7624d9c-6035-42dd-b8bb-13567c91d397 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.138203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.140239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.141688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.142463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.142873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.143220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.154734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.157441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f104c0-655b-4abe-8c5d-5c927861b370 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.170667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1060/2159] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:00.172562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156d30-dd78-4143-81b0-6023a304551f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.172957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156d30-dd78-4143-81b0-6023a304551f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.173264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39156d30-dd78-4143-81b0-6023a304551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.189642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1100/2160] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:00.194947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.200820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-39156d30-dd78-4143-81b0-6023a304551f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:00.202341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-39156d30-dd78-4143-81b0-6023a304551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:00.343676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1061/2161] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:00.349739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39156d30-dd78-4143-81b0-6023a304551f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.358384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401632dc-1eee-4273-a1b3-ca09cbb4cc53 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.363343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39156d30-dd78-4143-81b0-6023a304551f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.366230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.367295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.367870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.368352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.368546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.369840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.370134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.370593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.371071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.371343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:00.371653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.373575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.374319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.391624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1062/2162] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:40:00.392949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.409115 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad617b-9fbd-4d5b-9328-693dc856a858 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.413861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1101/2163] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:00.415330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.419107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.420670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.421155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.421671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.422554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.424858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.438906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e217-f405-4b1e-bddd-8d92b9bf07fb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.452349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.454145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.454536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.454919 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.456989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.460708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.483800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1102/2164] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:00.493650 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.496153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1063/2165] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:00.500252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.520750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c29b-c0b0-476a-8aae-48aef56d4a08 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.533424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:00.556341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:00.622356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4986d-84bd-4d91-8792-a0738b2ea151 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.632684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.638339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.638635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.638930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.640537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.643417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.658247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.659176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.659441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.659727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] PATH_INFO: `/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d/users/4e5a8280eb5641e7a30919a571f401c3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.681076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633d7515c7db47c5a258a9aa1b6b2a5d, user_id=4e5a8280eb5641e7a30919a571f401c3, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.684640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.687968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1064/2166] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:00.692913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.717792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1103/2167] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:00 2022] PUT /identity/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d/users/4e5a8280eb5641e7a30919a571f401c3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:00.721111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.726836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b2c93-0512-4180-9d2d-110558d05bbe admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.878338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9162f-d376-4c5d-8854-3af554af76a5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.882488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.883786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.885233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.886941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.888369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.889219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.890325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.892013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.892328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.892670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.893556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.895325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.908410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1104/2168] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:00.913134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.932335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1065/2169] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:00.934043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:00.935920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad076c3-65f2-43f3-b097-a34030ae66ed admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.942508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.943408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.943687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.943991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] PATH_INFO: `/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d/users/4e5a8280eb5641e7a30919a571f401c3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.946462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633d7515c7db47c5a258a9aa1b6b2a5d, user_id=4e5a8280eb5641e7a30919a571f401c3, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.950116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1644-9d88-45b6-992a-d6ecc1976f8e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:00.950465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e091d-12df-4569-8907-d999ccb54292 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.957868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:00.959907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.960381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.960905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.962176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:00.966696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:00.979211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1105/2170] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:00 2022] PUT /identity/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d/users/4e5a8280eb5641e7a30919a571f401c3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:00.980712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:00.980992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:00.981294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:00.993623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1066/2171] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:40:00.995941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.007617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c730ee8-e7de-4919-b0cf-117617b434fb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.011534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] MFA Rules not processed for user `4e5a8280eb5641e7a30919a571f401c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:01.012939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:01.109266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.110740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.111956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.112441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] PATH_INFO: `/v3/projects/e8a8419955ac489982fd0af6efd49d4a/users/5f1da6a13a254fc0b5bb2519815c495e/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.124000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1106/2172] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:01.133815 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a8419955ac489982fd0af6efd49d4a, user_id=5f1da6a13a254fc0b5bb2519815c495e, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.138538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.140799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a391a32-e098-4f3a-8141-37794f2659a6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.156128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:01.176208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1067/2173] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:00 2022] PUT /identity/v3/projects/e8a8419955ac489982fd0af6efd49d4a/users/5f1da6a13a254fc0b5bb2519815c495e/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:01.187709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.187966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.188291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.219085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:01.228200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbaedf-be3a-492a-aa15-eb952998080a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.231908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] MFA Rules not processed for user `5f1da6a13a254fc0b5bb2519815c495e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:01.233132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:01.329891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.330571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.330853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.331223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.331672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1068/2174] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:01.332850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.334447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:01.408665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.409333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c31c18-f822-43d6-a171-c5e02798525e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.410350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.414204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.415077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.415358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.415631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] PATH_INFO: `/v3/users/140a9484151c4904a25b6056f2e49520` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.417737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] RBAC: Authorizing `identity:delete_user(user_id=140a9484151c4904a25b6056f2e49520)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.419663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.424449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1107/2175] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:01.425159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.439888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbb8a4-a903-40a7-b53f-0d71bfa0f80d service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.468094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.468912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.469293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.469706 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.470801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.473020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.486439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140a9484151c4904a25b6056f2e49520'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.498226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140a9484151c4904a25b6056f2e49520'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.506551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1108/2176] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:01 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:01.507185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140a9484151c4904a25b6056f2e49520'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.512938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.521204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140a9484151c4904a25b6056f2e49520'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.522720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140a9484151c4904a25b6056f2e49520'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.543182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1069/2177] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:01 2022] DELETE /identity/v3/users/140a9484151c4904a25b6056f2e49520 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:01.620707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c827-8956-4c29-90e8-1d7330e90486 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.625567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:01.700343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.701031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.701352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.701636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.702337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.705466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.733372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1109/2178] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:01 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:01.737936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.739430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:01.758174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea272c43-2b42-4d9e-a9d1-66caea51094e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.764025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.764925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.765240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.765532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.766353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.767858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.768145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.772483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:01.782095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1070/2179] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:01.786360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.803793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d251372-59be-41b4-b453-71764d1f4962 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.809994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077e78-7c72-417c-b27c-dc81698bb0a7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.812225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.813107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.813605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.813735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] PATH_INFO: `/v3/projects/49d99b1f2c324aef91d2b56899ff631f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.814905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d99b1f2c324aef91d2b56899ff631f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.816952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.820509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.821466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.821756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.822663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.823539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.825152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.828084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:01.840876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1071/2180] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:01.856891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:01.878519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a676-886f-4dbf-8205-27bece22afb1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:01.895116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:01.896614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.896927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.897223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] PATH_INFO: `/v3/projects/431c23795d5b45eebf6f8c4dcee999bd/users/d84459c4cadd4b5eaf9212c70ac96f7f/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.925367 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431c23795d5b45eebf6f8c4dcee999bd, user_id=d84459c4cadd4b5eaf9212c70ac96f7f, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:01.925508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d99b1f2c324aef91d2b56899ff631f', 'request_id': 'req-eded4732-b69c-4024-be59-0f6ad5588ed6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.930290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f43e5-b8fc-4718-88ba-b5d0952a80c7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:01.933473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d99b1f2c324aef91d2b56899ff631f', 'request_id': 'req-eded4732-b69c-4024-be59-0f6ad5588ed6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.945812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d99b1f2c324aef91d2b56899ff631f', 'request_id': 'req-eded4732-b69c-4024-be59-0f6ad5588ed6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.959041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1072/2181] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:01 2022] PUT /identity/v3/projects/431c23795d5b45eebf6f8c4dcee999bd/users/d84459c4cadd4b5eaf9212c70ac96f7f/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:01.970246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.970691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.971170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:01.974143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] The token cache is being invalidate because project 49d99b1f2c324aef91d2b56899ff631f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:01.974542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.975272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-eded4732-b69c-4024-be59-0f6ad5588ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:01.981702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1110/2182] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:01 2022] DELETE /identity/v3/projects/49d99b1f2c324aef91d2b56899ff631f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:01.983421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d620-6498-437d-abef-5698fe10e39e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:01.983705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d620-6498-437d-abef-5698fe10e39e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:01.984144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915d620-6498-437d-abef-5698fe10e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.030633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6915d620-6498-437d-abef-5698fe10e39e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:02.031865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6915d620-6498-437d-abef-5698fe10e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.039926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] MFA Rules not processed for user `d84459c4cadd4b5eaf9212c70ac96f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:02.042131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.107412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1111/2183] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:02.117278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.117599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.117882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.141957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1073/2184] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:02.143473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.146788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.149381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:02.151528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.168945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1112/2185] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:02.169676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde45a3-0eea-4a8c-91cb-68855577beb9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.173546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.177029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.177969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.178586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.178876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.179587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.182164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.183307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2ac9-8e57-4ebf-b6f7-8117070d4e9e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.188378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.189032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.189637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.189914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.190683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:02.190988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.192640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.205627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:02.211376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1113/2186] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:40:02.218342 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.226743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1074/2187] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:02.231172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.236391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c75071-24b4-4ff4-b012-8c2abf5b9036 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.342766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.343774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.344372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.344800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.345955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.348326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.369447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bde26-e4b8-4bbd-8d4e-9cb8ec41bd1c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.383413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.384614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.385138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.385948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.386776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.392013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.392599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1114/2188] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:02.393562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.415384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1075/2189] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:40:02.420593 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.431267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3412c17-1305-411d-9c61-5f0807b7ad1f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.460506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:02.461470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f259b1-8866-468d-a198-6b471e635c88 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.469740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.470443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.470753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.471024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.471725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.473702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.492455 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.493117 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.493447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.493699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.494807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1115/2190] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:02.494999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.496701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.500064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.507411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1076/2191] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:40:02.510419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7f3eb-7e6a-4762-9c51-0a6bd48379b6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.511324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.514972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.515652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.515933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.516206 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.516920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.518641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.520871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09743abd-b09a-438b-b6ca-dd38f10d0939 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.526395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.527251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.527535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.527808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] PATH_INFO: `/v3/projects/57bd91bb1e164610a021cf05a78d9b26/users/4372212bee69427e90463450044f943b/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.529209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1116/2192] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:02.533069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.544024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bd91bb1e164610a021cf05a78d9b26, user_id=4372212bee69427e90463450044f943b, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.544406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6510-d663-43a7-8627-19fcfe77b575 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.546936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.549171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.549870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.550154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.550435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.551150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.552736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.563633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1077/2193] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:02 2022] PUT /identity/v3/projects/57bd91bb1e164610a021cf05a78d9b26/users/4372212bee69427e90463450044f943b/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:02.567048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1117/2194] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:40:02.567308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.571373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.584237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ab945-a7af-4242-a6ae-93634ed7ea0f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.632785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:02.634137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb6614-43aa-40df-a7ae-cf2eccde8c0d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.641307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.641962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.642242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.642510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.643235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.644614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.644814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.645556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.645837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.646248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] PATH_INFO: `/v3/projects/c9b5eb6ef5a942be9fcea8b26370a6fc/users/2768181f8a814902b8dcf50ce32907d0/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.655854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1078/2195] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:02.659947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.661870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b5eb6ef5a942be9fcea8b26370a6fc, user_id=2768181f8a814902b8dcf50ce32907d0, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.664545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb28b3-bb59-4553-9f2d-0d66da3119d9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.669910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0d266-9ba6-43d9-abf9-a4379e61939d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.674479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.675342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.675624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.675895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] PATH_INFO: `/v3/projects/57bd91bb1e164610a021cf05a78d9b26/users/4372212bee69427e90463450044f943b/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.677603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1118/2196] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:02 2022] PUT /identity/v3/projects/c9b5eb6ef5a942be9fcea8b26370a6fc/users/2768181f8a814902b8dcf50ce32907d0/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:02.681086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bd91bb1e164610a021cf05a78d9b26, user_id=4372212bee69427e90463450044f943b, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.681086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24633994-edd1-4da0-8e42-29c4f3c1509a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.682608 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.682896 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.683173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.691627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1079/2197] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:02 2022] PUT /identity/v3/projects/57bd91bb1e164610a021cf05a78d9b26/users/4372212bee69427e90463450044f943b/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:02.702622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:02.703888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.762288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.762473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.762757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.771216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1119/2198] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:02.781945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.783344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.790313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] MFA Rules not processed for user `4372212bee69427e90463450044f943b`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:02.791950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.840561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907c1dc-2f03-438a-8ea0-2a112a62772b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.844367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.845016 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.845325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.845600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.855770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:02.856997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d2dab-ee93-46ee-9d4f-c95d3ac4f988 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:02.864173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1080/2199] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:02.866775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1120/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:40:02.876076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:02.877640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:02.892462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:02.939132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ad32c-a187-4ebd-8986-8c98cd78c2e8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:02.944586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:02.945250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:02.945594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:02.945888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:02.948436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:03.016356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:03.017873 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:03.027926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1081/2201] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:07.239563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:07.240318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:07.240318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:07.241650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:07.255992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997e338-1918-4e0f-b189-feaa073fed16 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:07.261793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:07.262605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:07.263212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:07.263562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:07.309636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] MFA Rules not processed for user `2768181f8a814902b8dcf50ce32907d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:07.313426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:07.349519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:07.350983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:07.376808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1082/2202] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:07.421500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1121/2203] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:07.428336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:07.429827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:07.551821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:07.561415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963178a8-9d5b-4c44-81af-5f12090a83c8 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:07.568615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:07.569339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:07.569674 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:07.570083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:07.580584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:07.582276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:07.597365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1083/2204] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:08.248244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:08.249790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:08.265560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e73011-3721-403d-a968-9f0695cdb8af None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:08.273305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:08.273996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:08.274484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:08.275411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:08.286061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:08.289510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:08.291509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9189d-987e-460e-9161-674d210bd0c9 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:08.305973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1122/2205] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:09.404765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:09.418416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0395c-c923-45c9-a46d-a16b94d460c8 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:09.423129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:09.424656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:09.425263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:09.426283 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:09.428778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:09.457984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:09.458466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:09.458544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:09.490394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] MFA Rules not processed for user `2768181f8a814902b8dcf50ce32907d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:09.492373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:09.508687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1123/2206] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:09.561886 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:09.565432 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec0a0d-358f-46ed-98ac-d029934a1790 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:09.582132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1084/2207] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:14.910318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:14.924089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4852399-fc2c-41d5-888d-24af1b538142 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:14.942287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:14.943374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:14.943500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:14.944081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] PATH_INFO: `/v3/users/5f1da6a13a254fc0b5bb2519815c495e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:14.946009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1da6a13a254fc0b5bb2519815c495e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:14.948506 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:15.053500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1da6a13a254fc0b5bb2519815c495e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.063946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1da6a13a254fc0b5bb2519815c495e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.077854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1da6a13a254fc0b5bb2519815c495e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.078709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1da6a13a254fc0b5bb2519815c495e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.100280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1da6a13a254fc0b5bb2519815c495e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.108116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1124/2208] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:14 2022] DELETE /identity/v3/users/5f1da6a13a254fc0b5bb2519815c495e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:15.112857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:15.113398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:15.113590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:15.132598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:15.134546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:15.215167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1085/2209] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:15.224693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:15.226598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:15.306747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c68ce8-966f-4759-8e14-a7f53d2b0f17 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:15.311466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:15.312520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:15.313154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:15.313708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:15.327985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:15.329482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:15.340521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1125/2210] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:15.625433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:15.626927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:15.645651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5c07-74ac-4c7f-ad46-3e86b5903d9c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:15.651270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:15.652233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:15.652439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:15.652739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] PATH_INFO: `/v3/projects/e8a8419955ac489982fd0af6efd49d4a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:15.653977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a8419955ac489982fd0af6efd49d4a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:15.655880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:15.702683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a8419955ac489982fd0af6efd49d4a', 'request_id': 'req-09085789-6342-47a2-8bc1-c487aee3a9a2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.708229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a8419955ac489982fd0af6efd49d4a', 'request_id': 'req-09085789-6342-47a2-8bc1-c487aee3a9a2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.716668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a8419955ac489982fd0af6efd49d4a', 'request_id': 'req-09085789-6342-47a2-8bc1-c487aee3a9a2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.727483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] The token cache is being invalidate because project e8a8419955ac489982fd0af6efd49d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:15.728465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.729476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.731000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1086/2211] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:15 2022] DELETE /identity/v3/projects/e8a8419955ac489982fd0af6efd49d4a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:15.735647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:15.745915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d98a5-73e0-424a-94d2-11c8b9f18687 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:15.807735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:15.808709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:15.809060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:15.809415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] PATH_INFO: `/v3/users/d84459c4cadd4b5eaf9212c70ac96f7f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:15.810780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84459c4cadd4b5eaf9212c70ac96f7f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:15.813626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:15.819354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:15.876849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84459c4cadd4b5eaf9212c70ac96f7f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.886254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84459c4cadd4b5eaf9212c70ac96f7f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.894023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84459c4cadd4b5eaf9212c70ac96f7f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.894726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84459c4cadd4b5eaf9212c70ac96f7f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.911479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84459c4cadd4b5eaf9212c70ac96f7f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:15.920860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1126/2212] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:15 2022] DELETE /identity/v3/users/d84459c4cadd4b5eaf9212c70ac96f7f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:16.355721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:16.358760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.377390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:16.379084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.391923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085789-6342-47a2-8bc1-c487aee3a9a2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:16.399076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:16.477459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533178f-bf28-4aa1-809b-e59f421cceeb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:16.483270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:16.484310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.484602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.484994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] PATH_INFO: `/v3/projects/431c23795d5b45eebf6f8c4dcee999bd` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.486610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431c23795d5b45eebf6f8c4dcee999bd)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:16.488993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:16.516043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:16.517357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.517966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.518451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] PATH_INFO: `/v3/users/ccf36446834f4597a46ea1289e06bd44` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.520676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf36446834f4597a46ea1289e06bd44)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:16.524119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:16.560401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431c23795d5b45eebf6f8c4dcee999bd', 'request_id': 'req-4f504c01-e516-42dd-99c5-d05f7de24ad9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.568434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431c23795d5b45eebf6f8c4dcee999bd', 'request_id': 'req-4f504c01-e516-42dd-99c5-d05f7de24ad9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.577200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431c23795d5b45eebf6f8c4dcee999bd', 'request_id': 'req-4f504c01-e516-42dd-99c5-d05f7de24ad9'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.595693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf36446834f4597a46ea1289e06bd44'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.596561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] The token cache is being invalidate because project 431c23795d5b45eebf6f8c4dcee999bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:16.596940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.597908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.600587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1127/2213] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:16 2022] DELETE /identity/v3/projects/431c23795d5b45eebf6f8c4dcee999bd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:16.605014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:16.606858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.607175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf36446834f4597a46ea1289e06bd44'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.615177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf36446834f4597a46ea1289e06bd44'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.624856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:16.631705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf36446834f4597a46ea1289e06bd44'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.632662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-13c378c8-4c49-472a-ac0d-188abd6da150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf36446834f4597a46ea1289e06bd44'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.642182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1087/2214] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:16 2022] DELETE /identity/v3/users/ccf36446834f4597a46ea1289e06bd44 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:16.648116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.648500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.649169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.671001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:16.672480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.723961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504c01-e516-42dd-99c5-d05f7de24ad9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:16.762730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1088/2215] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:16.775433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:16.778959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.798395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:16.799698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.800102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.800877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] PATH_INFO: `/v3/users/4372212bee69427e90463450044f943b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.802522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4372212bee69427e90463450044f943b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:16.804595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:16.833648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:16.882611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d396d9-24a8-4563-9793-aa5100571505 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:16.894253 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4372212bee69427e90463450044f943b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.900333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:16.901027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.901380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.901679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.906399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4372212bee69427e90463450044f943b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.920948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:16.922538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:16.923167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4372212bee69427e90463450044f943b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.923977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4372212bee69427e90463450044f943b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.937420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1089/2216] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:40:16.938193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:16.939852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:16.950733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e91fe165-03f8-4a58-85e8-a4c2298acebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4372212bee69427e90463450044f943b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:16.953913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16bf3-8450-478d-acd9-dc4b7a3f0f2a service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:16.959445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1128/2217] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:16 2022] DELETE /identity/v3/users/4372212bee69427e90463450044f943b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:16.963265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:16.963265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:16.963265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:16.963265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] PATH_INFO: `/v3/users/a1590be76bf640e69581d5477abf62a3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:16.964371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1590be76bf640e69581d5477abf62a3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:16.967386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:17.048961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1590be76bf640e69581d5477abf62a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.060098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1590be76bf640e69581d5477abf62a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.074618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1590be76bf640e69581d5477abf62a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.099701 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1590be76bf640e69581d5477abf62a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.100428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1590be76bf640e69581d5477abf62a3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.124271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1090/2218] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:16 2022] DELETE /identity/v3/users/a1590be76bf640e69581d5477abf62a3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:17.128603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.129840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.130129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.155683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:17.157108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.202604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:17.286130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1129/2219] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:17.308365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.310235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.408134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0b97d-0c11-4298-9fcb-4b7fe534222a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:17.413717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:17.414488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.414833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.415438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.451860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:17.453744 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa2c23-9ad3-4c4f-ad8a-353cc9130dc5 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:17.472325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.473868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.476071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1091/2220] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:17.491564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45846d1e-0fb4-4281-8001-ab90eee042e3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:17.501799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:17.502976 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.503549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.504077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] PATH_INFO: `/v3/projects/7d0e39331e1e42b8b671d84747ec9255` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.506244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0e39331e1e42b8b671d84747ec9255)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:17.508437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:17.570520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0e39331e1e42b8b671d84747ec9255', 'request_id': 'req-2524288a-5ead-48ee-b396-0ae7fa52bccd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.578384 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0e39331e1e42b8b671d84747ec9255', 'request_id': 'req-2524288a-5ead-48ee-b396-0ae7fa52bccd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.585474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0e39331e1e42b8b671d84747ec9255', 'request_id': 'req-2524288a-5ead-48ee-b396-0ae7fa52bccd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.603054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] The token cache is being invalidate because project 7d0e39331e1e42b8b671d84747ec9255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:17.604065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.604583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.607211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1130/2221] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:17 2022] DELETE /identity/v3/projects/7d0e39331e1e42b8b671d84747ec9255 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:17.612077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbadc2-8f0e-425a-80cc-ad2a9c90ce7f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.612386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbadc2-8f0e-425a-80cc-ad2a9c90ce7f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.612695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbadc2-8f0e-425a-80cc-ad2a9c90ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.640469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d5dbadc2-8f0e-425a-80cc-ad2a9c90ce7f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:17.642101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d5dbadc2-8f0e-425a-80cc-ad2a9c90ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.655055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.657226 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.733935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:17.761423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1092/2222] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:17.766505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524288a-5ead-48ee-b396-0ae7fa52bccd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:17.768964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.769308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.769565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.771911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:17.772792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.773237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.773381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] PATH_INFO: `/v3/projects/57bd91bb1e164610a021cf05a78d9b26` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.775322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bd91bb1e164610a021cf05a78d9b26)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:17.779199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:17.795206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:17.797466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:17.811437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1093/2223] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:17.812887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.824306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5facc87-75d8-4f5c-b474-8ad09f168fa9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:17.829319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:17.830015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:17.830301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:17.830576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:17.831310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:17.831749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:17.833411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:17.849572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bd91bb1e164610a021cf05a78d9b26', 'request_id': 'req-22d729df-76fc-4e02-b4b5-f34af8430d16'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.849838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1094/2224] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:40:17.854203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.868564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bd91bb1e164610a021cf05a78d9b26', 'request_id': 'req-22d729df-76fc-4e02-b4b5-f34af8430d16'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.880798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d50677-2da6-4ac4-894c-9d01cfa6bfe1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:17.883197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bd91bb1e164610a021cf05a78d9b26', 'request_id': 'req-22d729df-76fc-4e02-b4b5-f34af8430d16'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.887556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:17.910522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] The token cache is being invalidate because project 57bd91bb1e164610a021cf05a78d9b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:17.910805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.911983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:17.915722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1131/2225] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:17 2022] DELETE /identity/v3/projects/57bd91bb1e164610a021cf05a78d9b26 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:17.994968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:17.997538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.002604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.004925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.010470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.010979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.011818 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.016173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.025712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d729df-76fc-4e02-b4b5-f34af8430d16 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.034499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.035930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.036225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.036675 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] PATH_INFO: `/v3/projects/589ae904ad7246af967e452db5e82919` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.038932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589ae904ad7246af967e452db5e82919)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.042845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.058994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1095/2226] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:17 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:40:18.066309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.069137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.140882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589ae904ad7246af967e452db5e82919', 'request_id': 'req-8db2962c-0ab2-4520-81bc-c9df9e511301'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.148080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589ae904ad7246af967e452db5e82919', 'request_id': 'req-8db2962c-0ab2-4520-81bc-c9df9e511301'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.157937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589ae904ad7246af967e452db5e82919', 'request_id': 'req-8db2962c-0ab2-4520-81bc-c9df9e511301'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.174877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] The token cache is being invalidate because project 589ae904ad7246af967e452db5e82919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:18.175316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.176006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.177938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1132/2227] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:17 2022] DELETE /identity/v3/projects/589ae904ad7246af967e452db5e82919 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:18.182170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.183595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.184945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba50b45-3e2a-4543-96bd-f2148c7013ab admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.258203 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:18.266054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.268214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.268724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.269035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.270141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.271513 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2962c-0ab2-4520-81bc-c9df9e511301 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.272681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.277937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.278835 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.279116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.279409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] PATH_INFO: `/v3/users/4e5a8280eb5641e7a30919a571f401c3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.280632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5a8280eb5641e7a30919a571f401c3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.282696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.298196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1096/2228] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:18 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:40:18.299245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.304600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.320627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fc995-2436-4ded-88b1-3a9546090f01 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.327711 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.328696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.329006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.329343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] PATH_INFO: `/v3/users/e5b47465e61c4cd68bdde5abe565313a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.330697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b47465e61c4cd68bdde5abe565313a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.332956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.344259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5a8280eb5641e7a30919a571f401c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.353619 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5a8280eb5641e7a30919a571f401c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.362925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5a8280eb5641e7a30919a571f401c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.363698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5a8280eb5641e7a30919a571f401c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.379181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:18.380816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5a8280eb5641e7a30919a571f401c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.388476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b47465e61c4cd68bdde5abe565313a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.390458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1133/2229] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:18 2022] DELETE /identity/v3/users/4e5a8280eb5641e7a30919a571f401c3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:18.391934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.394026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.397610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b47465e61c4cd68bdde5abe565313a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.407222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b47465e61c4cd68bdde5abe565313a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.422551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b47465e61c4cd68bdde5abe565313a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.423312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-18fc7910-241e-4380-b736-caf4519cfa79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b47465e61c4cd68bdde5abe565313a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:18.432565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1097/2230] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:18 2022] DELETE /identity/v3/users/e5b47465e61c4cd68bdde5abe565313a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:18.439358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.439653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.442130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.473801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:18.475172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.476421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193be9-9795-4601-8261-53102f0084af admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.555620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.556906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.557217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.557496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.558386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.560333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.573228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1134/2231] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:18.573442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1098/2232] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:18.578483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.580402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.583460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.584950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.597381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028e77-b734-47bd-8b2d-f225a5c79b79 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.606799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.607329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.607612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.607884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.608614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.610299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.625233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1135/2233] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:18.629349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.640458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce4dfe-1cbc-4918-b592-49acb57490c7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.657855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0be27-a491-4795-831b-af477726427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.659320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0be27-a491-4795-831b-af477726427f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.659431 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0be27-a491-4795-831b-af477726427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.659876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0be27-a491-4795-831b-af477726427f admin admin] PATH_INFO: `/v3/projects/235634c0fcf14ebeab084cfca36d394b/users/33ffdc9526374a07b696f5cc59b22ef7/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.662424 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4524d-4cf8-4f91-bfd4-633e8f27abd0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.666590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.667490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.668430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.668913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.679585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0be27-a491-4795-831b-af477726427f admin admin] RBAC: Authorizing `identity:create_grant(project_id=235634c0fcf14ebeab084cfca36d394b, user_id=33ffdc9526374a07b696f5cc59b22ef7, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.681761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.683746 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1850a-af86-45a9-adfb-976bbad36d07 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.685631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0be27-a491-4795-831b-af477726427f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.695506 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1099/2234] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:18.709086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1136/2235] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:18 2022] PUT /identity/v3/projects/235634c0fcf14ebeab084cfca36d394b/users/33ffdc9526374a07b696f5cc59b22ef7/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:18.715215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.715578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.715925 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.722102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:18.739706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:18.741069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.795532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0be27-a491-4795-831b-af477726427f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.799250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-42e0be27-a491-4795-831b-af477726427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.859031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1100/2236] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:18.870237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:18.872133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:18.908486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0be27-a491-4795-831b-af477726427f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.924761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.926235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.926912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.927482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] PATH_INFO: `/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:18.930791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633d7515c7db47c5a258a9aa1b6b2a5d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:18.933327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:18.943138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:18.975503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dfe67-4438-4358-8012-b4bf40ef65ec None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:18.985107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:18.985522 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:18.985819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:18.986087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.002292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633d7515c7db47c5a258a9aa1b6b2a5d', 'request_id': 'req-2956006a-79a0-4937-82d7-a99c6ab7a509'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.005501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.008603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633d7515c7db47c5a258a9aa1b6b2a5d', 'request_id': 'req-2956006a-79a0-4937-82d7-a99c6ab7a509'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.009320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65701995-694a-429d-bb3f-1588248b1da2 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.016315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633d7515c7db47c5a258a9aa1b6b2a5d', 'request_id': 'req-2956006a-79a0-4937-82d7-a99c6ab7a509'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.026242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1101/2237] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:19.034186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] The token cache is being invalidate because project 633d7515c7db47c5a258a9aa1b6b2a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:19.035381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.035381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.036839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1137/2238] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:18 2022] DELETE /identity/v3/projects/633d7515c7db47c5a258a9aa1b6b2a5d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:19.043104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e27f-99d9-450f-aa0b-69120f3aaf9a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.043393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e27f-99d9-450f-aa0b-69120f3aaf9a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.044030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015e27f-99d9-450f-aa0b-69120f3aaf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.061411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.063439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.064079 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6015e27f-99d9-450f-aa0b-69120f3aaf9a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:19.065324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6015e27f-99d9-450f-aa0b-69120f3aaf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.147654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956006a-79a0-4937-82d7-a99c6ab7a509 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.158431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1102/2239] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:19.160150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.160403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.160685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.161016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.161290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.161638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.161981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] PATH_INFO: `/v3/projects/b6b594d577cd4f38b115c0f1c02d10b7` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.163282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b594d577cd4f38b115c0f1c02d10b7)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.166586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.182287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:19.183027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.194563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1103/2240] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:19.195662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.207540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867aeab-b9b0-4e1a-a349-8dc732095174 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.213887 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.214560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.214851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.215134 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.216004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:19.216316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.218099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.230173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b594d577cd4f38b115c0f1c02d10b7', 'request_id': 'req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.231974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1104/2241] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:40:19.236408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.241179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b594d577cd4f38b115c0f1c02d10b7', 'request_id': 'req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.249583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b594d577cd4f38b115c0f1c02d10b7', 'request_id': 'req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.249888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a6ac4-6f48-4dc6-b30d-4ccee2dce90e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.265818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] The token cache is being invalidate because project b6b594d577cd4f38b115c0f1c02d10b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:19.266364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.267105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0c8060e3-35df-4ea0-a8ba-4755078cc9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:19.269059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1138/2242] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:19 2022] DELETE /identity/v3/projects/b6b594d577cd4f38b115c0f1c02d10b7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:19.278189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e4fb-b09d-47fc-8c23-31642c4d7ccd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.278734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e4fb-b09d-47fc-8c23-31642c4d7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.279357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3e4fb-b09d-47fc-8c23-31642c4d7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.284680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:19.299957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-10e3e4fb-b09d-47fc-8c23-31642c4d7ccd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:19.301208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-10e3e4fb-b09d-47fc-8c23-31642c4d7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.325488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:19.326727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.327465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.327750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.328024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.328712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.330653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.363941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1105/2243] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:40:19.367687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.370351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.388367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1139/2244] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:19.390291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.390541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.390918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.410873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:19.412029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.442149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b39916-e854-487b-90f6-54fb986e8d8c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.447619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.448457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.448834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.449211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.450047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.452166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.476601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1106/2245] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:19.481451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.493022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecf5c0-8193-4fe1-8398-61cccbe4dcb6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.499121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.499905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.500267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.500618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.501470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.503201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.511912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1140/2246] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:19.518787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1107/2247] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:40:19.519001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.519901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.527209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a103-4567-43d8-80ed-180b848cc44b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.541580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475d75d-919f-461e-ac58-fd1e85cdb992 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.541814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.542378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.542658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.542947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.543699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:19.544010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.545799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.548960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.550097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.550681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.551317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.552361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.554510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.561046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1141/2248] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:40:19.565861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.567196 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1108/2249] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:19.571368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.583885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117a5ed-bf97-4abb-97a4-0edb7d21ab5f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.584914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ff390-860b-4f33-8726-d83bcee3cd77 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.591202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.592107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.592395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.592728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.593514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.595505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.596588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.598444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.598730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.599022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] PATH_INFO: `/v3/projects/ccf703fc0485416c84f350c5b031a66b/users/8b914539c9e44dafb8eb9bd9e6ec16c3/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.625238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf703fc0485416c84f350c5b031a66b, user_id=8b914539c9e44dafb8eb9bd9e6ec16c3, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.628906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa906a6-1b72-4713-af7f-9ae789110a83 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.647291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1142/2250] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:19.652948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.664459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1109/2251] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:19 2022] PUT /identity/v3/projects/ccf703fc0485416c84f350c5b031a66b/users/8b914539c9e44dafb8eb9bd9e6ec16c3/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:19.668024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.668352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.668679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.724211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] MFA Rules not processed for user `8b914539c9e44dafb8eb9bd9e6ec16c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:19.725769 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.761959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c0341-1437-4e43-997a-d9376fb799b8 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.770625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.772638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.772943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.773382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.774242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.777017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.797064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:19.819162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1143/2252] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:19.824774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.842657 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acfd67-cf13-41dc-9f98-622ec5a45337 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.852842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1110/2253] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:19.854227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.855540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.856274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.858312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:19.868274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.871012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.873885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.875583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.908852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1144/2254] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:19.915256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:19.947690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369b378-1ae8-4c35-9eea-764bdade95fd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.963289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6ee-87af-4717-bee4-4701dd43755b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:19.963762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.965089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.966277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.966574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.968587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:19.969295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:19.969587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:19.969861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:19.970598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.972218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.982982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:19.985237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834bf07-d514-4f9f-86f0-227222ebcc7c service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:19.986565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:19.997988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1145/2255] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:20.001595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:20.012771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1111/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:20.038225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685b6-75de-4e1d-a326-6dc9daa165a2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:20.054262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:20.055293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:20.055577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:20.056334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] PATH_INFO: `/v3/projects/a76fcf2656a04842855466b79918eff3/users/e090c058076345cfa1b10dba00efb863/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:20.079624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76fcf2656a04842855466b79918eff3, user_id=e090c058076345cfa1b10dba00efb863, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:20.083283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:20.112019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1146/2257] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:20 2022] PUT /identity/v3/projects/a76fcf2656a04842855466b79918eff3/users/e090c058076345cfa1b10dba00efb863/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:20.123361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cd8a-a176-4a41-acad-26983bacf80a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:20.123648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cd8a-a176-4a41-acad-26983bacf80a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:20.123926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cd8a-a176-4a41-acad-26983bacf80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:20.165526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1f82cd8a-a176-4a41-acad-26983bacf80a None None] MFA Rules not processed for user `e090c058076345cfa1b10dba00efb863`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:20.170980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1f82cd8a-a176-4a41-acad-26983bacf80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:20.299872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1112/2258] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:20.316107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:20.318167 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:20.431672 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127396d2-cb70-4517-8e12-d2e79b4415b2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:20.435752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:20.436699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:20.437378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:20.437812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:20.466821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:20.473079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc92917-e7c4-4ae5-8670-8c8949678d5f service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:20.498059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1147/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:21.229745 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:21.230215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:21.230292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:21.257262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] MFA Rules not processed for user `b991805cfa834aab8dcab7d94d108ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:21.261890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:21.336402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1113/2260] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:25.152720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.153311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.153311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.194105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] MFA Rules not processed for user `33ffdc9526374a07b696f5cc59b22ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:25.195328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:25.303791 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1148/2261] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:25.304965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.306870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:25.346235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:25.397712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5bcb-6246-4c72-858b-17f42ae27840 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.403315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.403995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.404277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.404553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.405584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.408029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.444090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1114/2262] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:25 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:25.445748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.463103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf84e0f-cfa7-45c9-b487-252feaa2e3ff None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.555715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.557691 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.557987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.559382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.561736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.564240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.576571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:25.591117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1149/2263] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:25 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:25.594742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.622652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4b64d-1299-488b-8cfa-81dd0887a2e7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.633285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.634963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.635409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.635840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.636993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.644421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.664272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1115/2264] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:25.668749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.681314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736eecc-1459-45cc-b8f3-b5504ecd1474 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.687490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.688246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.688593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.689743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] PATH_INFO: `/v3/projects/06620d963bdd4e86b2b1f406f36f96cc/users/346d46d2dd5c46b1b4475579a2a8a5a6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.722555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06620d963bdd4e86b2b1f406f36f96cc, user_id=346d46d2dd5c46b1b4475579a2a8a5a6, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.726432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.748286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1150/2265] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:25 2022] PUT /identity/v3/projects/06620d963bdd4e86b2b1f406f36f96cc/users/346d46d2dd5c46b1b4475579a2a8a5a6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:25.752836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.764906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5037-77c0-4aa1-b1f9-d801a6d940f5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.834275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.834952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.835263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.835560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.836299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.838457 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5370ced-42df-4280-9c77-22ea69e6e475 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.850267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1116/2266] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:25.855164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:25.870651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc30d9f-ace2-45e1-8070-542c86873007 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:25.876063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:25.877117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:25.877487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:25.877902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] PATH_INFO: `/v3/projects/06620d963bdd4e86b2b1f406f36f96cc/users/346d46d2dd5c46b1b4475579a2a8a5a6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:25.880021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06620d963bdd4e86b2b1f406f36f96cc, user_id=346d46d2dd5c46b1b4475579a2a8a5a6, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:25.882788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:25.902630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1151/2267] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:25 2022] PUT /identity/v3/projects/06620d963bdd4e86b2b1f406f36f96cc/users/346d46d2dd5c46b1b4475579a2a8a5a6/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:33.721675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe070f7-2f1a-42c2-a9ac-d992ea62fe71 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:33.722276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe070f7-2f1a-42c2-a9ac-d992ea62fe71 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:33.722276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe070f7-2f1a-42c2-a9ac-d992ea62fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:33.774946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0fe070f7-2f1a-42c2-a9ac-d992ea62fe71 None None] MFA Rules not processed for user `346d46d2dd5c46b1b4475579a2a8a5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:33.776919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0fe070f7-2f1a-42c2-a9ac-d992ea62fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:33.926549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1117/2268] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:33.933426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:34.084953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37dd031-dbbb-4c67-9a0f-d6e2da187c4c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:34.091046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:34.091977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:34.092416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:34.092831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:34.210997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:34.212349 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:34.223111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1152/2269] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:34.405480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc62c-4248-4de4-8385-f5cdb9ad99ec None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:34.405480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc62c-4248-4de4-8385-f5cdb9ad99ec None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:34.405480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbc62c-4248-4de4-8385-f5cdb9ad99ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:34.431567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-efcbc62c-4248-4de4-8385-f5cdb9ad99ec None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:34.432740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-efcbc62c-4248-4de4-8385-f5cdb9ad99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:34.449892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:34.515456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1118/2270] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:40:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:34.573330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:34.575021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:34.686354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24b30-b5f1-4b6f-870f-70997385c3cd service glance] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:34.694583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:34.695263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:34.695548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:34.695889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:34.708443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:34.710237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:34.720232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1153/2271] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:40:41.067230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cbe4-90dc-4bb7-8271-016566106aa6 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:41.067809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cbe4-90dc-4bb7-8271-016566106aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:41.067809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cbe4-90dc-4bb7-8271-016566106aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:41.090537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4ab6cbe4-90dc-4bb7-8271-016566106aa6 None None] MFA Rules not processed for user `c44b88237c0f4ae7a31fbaaddbb2d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:41.091952 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4ab6cbe4-90dc-4bb7-8271-016566106aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:41.165225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1119/2272] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:43.016636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:43.021444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:43.129426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dea20-a61f-43b2-877b-f8c53521a3ea service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:43.140827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:43.140827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:43.140827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:43.140827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] PATH_INFO: `/v3/users/8b914539c9e44dafb8eb9bd9e6ec16c3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:43.141293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b914539c9e44dafb8eb9bd9e6ec16c3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:43.141293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:43.269988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b914539c9e44dafb8eb9bd9e6ec16c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:43.296564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b914539c9e44dafb8eb9bd9e6ec16c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:43.308642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b914539c9e44dafb8eb9bd9e6ec16c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:43.309404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b914539c9e44dafb8eb9bd9e6ec16c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:43.326326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b914539c9e44dafb8eb9bd9e6ec16c3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:43.336491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1154/2273] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:43 2022] DELETE /identity/v3/users/8b914539c9e44dafb8eb9bd9e6ec16c3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:43.338185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:43.338683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:43.338778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:43.386305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:43.387870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:43.486094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1120/2274] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:43.498063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:43.499612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:43.572794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb06d5a-624b-485d-956e-d550cabc6b8c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:43.589519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:43.590402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:43.590820 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:43.591201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:43.608412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:43.611283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf083cb-e8ee-405d-8ad0-395a32895982 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:43.647265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1155/2275] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:44.312552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:44.314551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:44.339364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71add8ca-d54a-4d91-b408-fd028c95ace5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:44.354178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:44.355310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:44.355691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:44.356900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] PATH_INFO: `/v3/projects/ccf703fc0485416c84f350c5b031a66b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:44.358462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf703fc0485416c84f350c5b031a66b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:44.360798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:44.462344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf703fc0485416c84f350c5b031a66b', 'request_id': 'req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:44.471755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf703fc0485416c84f350c5b031a66b', 'request_id': 'req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:44.478752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:44.499776 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf703fc0485416c84f350c5b031a66b', 'request_id': 'req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:44.529408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] The token cache is being invalidate because project ccf703fc0485416c84f350c5b031a66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:44.530076 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:44.532896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0e4a23cd-25e4-44ff-90bf-bf44f91c2091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:44.539178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1121/2276] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:44 2022] DELETE /identity/v3/projects/ccf703fc0485416c84f350c5b031a66b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:44.540772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:44.541296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:44.541438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:44.582529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:44.584170 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:44.621459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:44.710720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:44.712004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:44.712468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:44.713979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1156/2277] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:44.735299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:44.736622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:44.766863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:44.778765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1122/2278] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:44.783571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ab936-8294-45ac-9b2b-21f23c2370d7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:44.806988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:44.807747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:44.808035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:44.808318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:44.809069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:44.817225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:44.818687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:44.867099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1157/2279] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:40:44.873345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:44.896738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f23f2-80e6-42e1-90ef-5b5869c67c0b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:44.927097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:44.927515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:44.927805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:44.928088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:44.934126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:44.939111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:44.996214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:44.997059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1123/2280] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:44 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:45.010623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b0d64-7436-4209-8a16-31ac5baf017d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:45.153632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:45.155524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.158886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.159652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.161452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:45.168251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:45.260915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:45.277585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1158/2281] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:44 2022] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:40:45.278861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388f80d-8967-40a9-8e45-af34281c5800 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:45.291716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:45.292409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.292693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.292968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.293732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:45.295505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:45.321967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1124/2282] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:45.326247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:45.344667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696d7f1-70b7-49c9-b8fb-dedc60970be5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:45.355254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:45.355938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.356330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.357445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.359644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:45.361000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a2854-0849-4116-8d7b-5a230dee75ef admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:45.389668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1159/2283] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:45.390751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:45.404166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469671-0ad9-41d4-a362-597d54d89e21 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:45.418121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:45.419631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.420217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.420781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] PATH_INFO: `/v3/projects/44fb74dd337c49a898397e3482e4305d/users/26738ea4f6d54d7d81f1ec5057c237ff/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.456476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fb74dd337c49a898397e3482e4305d, user_id=26738ea4f6d54d7d81f1ec5057c237ff, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:45.459970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:45.497131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1125/2284] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:45 2022] PUT /identity/v3/projects/44fb74dd337c49a898397e3482e4305d/users/26738ea4f6d54d7d81f1ec5057c237ff/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:40:45.498316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a792478-9803-46a1-bb70-872b49413770 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.498720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a792478-9803-46a1-bb70-872b49413770 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.499079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a792478-9803-46a1-bb70-872b49413770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.532700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4a792478-9803-46a1-bb70-872b49413770 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:45.536544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4a792478-9803-46a1-bb70-872b49413770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:45.674603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1160/2285] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:45.685689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:45.687860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:45.796218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14031f-c5da-4c76-b265-8d3ce60c3be6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:45.801869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:45.802633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:45.802989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:45.803339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:45.821233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:45.825967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a23dca-3ccc-49bc-a531-15c057843033 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:45.848708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1126/2286] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:48.805872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:48.805872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:48.805872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:48.826588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] MFA Rules not processed for user `33ffdc9526374a07b696f5cc59b22ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:48.828014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:48.875011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:48.938393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1161/2287] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:51.775332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:51.782926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:51.783464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:51.844518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] MFA Rules not processed for user `26738ea4f6d54d7d81f1ec5057c237ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:51.845987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:51.959404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:51.966413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1127/2288] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:51.971187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179f51-daf9-4f98-b956-45896a46fb73 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:51.976951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:51.977853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:51.978329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:51.978887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:51.983760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:51.985927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.025141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1162/2289] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:51 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:52.026482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:52.037601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b792a9-1ec6-4f4f-a36a-f04bb9307a06 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:52.062456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:52.127395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:52.128082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.128366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.128643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.129425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:52.131352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.152529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1128/2290] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:52 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:52.156443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:52.169076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28587bb-0ff9-4996-b31a-2e010209bd1b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:52.175344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:52.176091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.176377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.176680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.177460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:52.179076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.191569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1163/2291] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:52.195878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:52.206737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46907-5dd5-4774-a22f-70780559cbcd admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:52.211895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:52.212801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.213086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.213405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] PATH_INFO: `/v3/projects/e11d5ed75eca4fdb9b03bcce98078397/users/0f4524b4093046efa0f3d5fb0ecc0b22/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.230398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11d5ed75eca4fdb9b03bcce98078397, user_id=0f4524b4093046efa0f3d5fb0ecc0b22, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:52.233167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.248998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1129/2292] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:52 2022] PUT /identity/v3/projects/e11d5ed75eca4fdb9b03bcce98078397/users/0f4524b4093046efa0f3d5fb0ecc0b22/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:52.253175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:52.266160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2b106-9cfd-49d3-83bc-8f69a9119e1e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:52.373739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:52.374727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.375012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.375339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.376088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:52.377819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff9561-9fe9-4b82-9318-2c270c6dcf75 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.393320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1164/2293] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:40:52.394987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:52.438520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0801ee-1181-4b81-945f-6358604514b4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:52.443571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:52.444473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.444755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.445849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] PATH_INFO: `/v3/projects/e11d5ed75eca4fdb9b03bcce98078397/users/0f4524b4093046efa0f3d5fb0ecc0b22/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.448082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11d5ed75eca4fdb9b03bcce98078397, user_id=0f4524b4093046efa0f3d5fb0ecc0b22, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:52.450753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:52.478344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1130/2294] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:52 2022] PUT /identity/v3/projects/e11d5ed75eca4fdb9b03bcce98078397/users/0f4524b4093046efa0f3d5fb0ecc0b22/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:52.927095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:52.927429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:52.927716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:52.963829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:52.964916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:53.075151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1165/2295] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:40:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:53.089989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:53.102625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:53.209986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4847-221f-4f26-a9d8-f115114039e0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:53.229358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:53.230053 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:53.230336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:53.230620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:53.241484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:53.243462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b031999-854e-4232-9c41-ab3392d823fc service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:53.267831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1131/2296] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:40:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:40:53.904574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:53.907189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:54.065127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:54.125759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e4efa-0f81-4c69-8777-ce62cc2b1de6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:54.132119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:54.133821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:54.134351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:54.134836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] PATH_INFO: `/v3/users/e090c058076345cfa1b10dba00efb863` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:54.136580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e090c058076345cfa1b10dba00efb863)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:54.143811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:54.254292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e090c058076345cfa1b10dba00efb863'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:54.289951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e090c058076345cfa1b10dba00efb863'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:54.306176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e090c058076345cfa1b10dba00efb863'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:54.307325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e090c058076345cfa1b10dba00efb863'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:54.375863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e090c058076345cfa1b10dba00efb863'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:54.400988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1166/2297] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:40:53 2022] DELETE /identity/v3/users/e090c058076345cfa1b10dba00efb863 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:54.405398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:54.409678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:54.410136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:54.465785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:54.469843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:54.622791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1132/2298] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:54.843112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:54.845955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:55.146509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e1a5-fb5c-44d6-abc5-998e546732de admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:55.177476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:55.182732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:55.183046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:55.183328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:55.224131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:55.227361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07348db-e74c-4873-b8c4-5c698cd31cb9 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:55.280900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1167/2299] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:55.975118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:55.978015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:55.987510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:56.013802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e01ec2-48ea-4c82-8dff-8b6409e35921 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:56.028245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:56.030362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:56.030664 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:56.030943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] PATH_INFO: `/v3/projects/a76fcf2656a04842855466b79918eff3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:56.042637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76fcf2656a04842855466b79918eff3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:56.051305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:56.210098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76fcf2656a04842855466b79918eff3', 'request_id': 'req-2d92b273-37e9-4fd8-8bca-60350fe95de4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:56.234752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76fcf2656a04842855466b79918eff3', 'request_id': 'req-2d92b273-37e9-4fd8-8bca-60350fe95de4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:56.262590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76fcf2656a04842855466b79918eff3', 'request_id': 'req-2d92b273-37e9-4fd8-8bca-60350fe95de4'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:56.302549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] The token cache is being invalidate because project a76fcf2656a04842855466b79918eff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:40:56.302987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:56.309754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d92b273-37e9-4fd8-8bca-60350fe95de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:40:56.313639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1133/2300] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:40:55 2022] DELETE /identity/v3/projects/a76fcf2656a04842855466b79918eff3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:56.320656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:56.321237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:56.321550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:56.351164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:56.352872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:56.578205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:56.580052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:56.580564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:56.581992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1168/2301] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:56.620336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:56.637436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:56.666201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1134/2302] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:56.667951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:56.690053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770409-d0a7-4704-b082-05c0d7da5dfd None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:56.710586 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:56.711278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:56.711603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:56.711862 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:56.712579 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:40:56.712880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:56.714541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:56.716354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:56.758303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1169/2303] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:40:56.767343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:56.793610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4daa4f-d9bf-4ffc-aa3f-671ef278d299 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:56.804784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:56.807103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:56.807393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:56.807679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:56.811631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:56.817852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:56.928808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1135/2304] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:40:56 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:56.931198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:56.947512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f7a35-1ff9-4e5b-bd9c-2da7e154e952 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:57.221255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:57.222864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.227639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.230719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:57.231897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:57.239869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:57.318742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:57.327147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1170/2305] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:40:56 2022] POST /identity/v3/users => generated 283 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:40:57.345917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513d508-8940-449c-905f-6eeb42c2c9ba admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:57.363239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:57.364715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.365356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.371993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:57.377764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:57.379799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:57.420107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1136/2306] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:57.424798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:57.441389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc71814-b8fe-4eb7-b6cd-eed3d58e63b0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:57.456990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:57.458811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.459536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.459982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:57.462383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:57.464245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afcd6a-8e0a-48c2-867b-f941b48ec4e5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:57.494821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1171/2307] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:40:57.498324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:57.514556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d60ef-f09a-4b4f-b8d0-040b4ac62ad4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:57.526255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:57.527159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.527629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.528068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] PATH_INFO: `/v3/projects/9985e10996e14c01881168b78ada2c22/users/3d0b564df8f44d2a9a23d08106a755b1/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:57.562480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9985e10996e14c01881168b78ada2c22, user_id=3d0b564df8f44d2a9a23d08106a755b1, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:57.565663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:57.598546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1137/2308] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:40:57 2022] PUT /identity/v3/projects/9985e10996e14c01881168b78ada2c22/users/3d0b564df8f44d2a9a23d08106a755b1/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:40:57.610694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc936-fa18-42fe-a822-2bc66bb8d513 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.611251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc936-fa18-42fe-a822-2bc66bb8d513 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.611716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc936-fa18-42fe-a822-2bc66bb8d513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:57.665840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-db1dc936-fa18-42fe-a822-2bc66bb8d513 None None] MFA Rules not processed for user `3d0b564df8f44d2a9a23d08106a755b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:57.667279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-db1dc936-fa18-42fe-a822-2bc66bb8d513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:57.782476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1172/2309] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:40:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:40:57.795687 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:57.797635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:57.957961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef5738-ff3b-451d-8a49-8415162bdc09 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:57.966085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:57.967080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:57.967747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:57.968352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:58.029852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:58.033300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:58.081935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1138/2310] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:40:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:40:59.148389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19d86-daea-4d87-a141-0c9cc6541d5d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:59.148939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19d86-daea-4d87-a141-0c9cc6541d5d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:59.149045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19d86-daea-4d87-a141-0c9cc6541d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:59.196681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7af19d86-daea-4d87-a141-0c9cc6541d5d None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:40:59.202242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7af19d86-daea-4d87-a141-0c9cc6541d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:59.317946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1173/2311] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:40:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:40:59.354383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:40:59.361387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:40:59.424568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:40:59.526372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aae926-f2b0-418a-9b0a-1aceca63f3fe service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:40:59.532335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:40:59.533362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:40:59.533890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:40:59.534439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:40:59.548911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:40:59.551194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:40:59.580364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1139/2312] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:41:08.218263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d6c-04f0-4379-872d-83de3ab1013c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:08.220483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d6c-04f0-4379-872d-83de3ab1013c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:08.221133 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d6c-04f0-4379-872d-83de3ab1013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:08.246547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:08.288858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ba791d6c-04f0-4379-872d-83de3ab1013c None None] MFA Rules not processed for user `0f4524b4093046efa0f3d5fb0ecc0b22`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:08.294853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ba791d6c-04f0-4379-872d-83de3ab1013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:08.462304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1174/2313] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:08.478781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:08.480852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:08.676685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97154-e071-4465-aad0-82ffde6e0d91 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:08.688235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:08.688919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:08.695790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:08.696425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:08.699312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:08.861157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:08.863173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59753b8-9fa7-4ea1-9526-29d541d64027 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:08.879652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1140/2314] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:18.457601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=31 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:18.870721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=77 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:20.287558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:20.288097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:20.288097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:20.289546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1175/2315] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:41:20.298154 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95c5-3832-47d4-a9de-42d01ca503d9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:20.298599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95c5-3832-47d4-a9de-42d01ca503d9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:20.298762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e95c5-3832-47d4-a9de-42d01ca503d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:20.317486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-fd3e95c5-3832-47d4-a9de-42d01ca503d9 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:20.318994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fd3e95c5-3832-47d4-a9de-42d01ca503d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:20.329118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1141/2316] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:41:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:41:30.312518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:30.539007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:30.540722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:30.598496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6349142-bfe0-4a0b-a746-7290225c2d54 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:30.602031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:30.602709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.602991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.603267 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.614076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:30.615500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855b140-68fe-459f-9315-4db446269ecb service glance] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:30.628265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1176/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:41:30.696791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.697177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.697451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.699284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1142/2318] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:41:30.704535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928918-94ec-4996-bc66-b04276f3e914 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.704823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928918-94ec-4996-bc66-b04276f3e914 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.705097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928918-94ec-4996-bc66-b04276f3e914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.723683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cb928918-94ec-4996-bc66-b04276f3e914 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:30.724880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cb928918-94ec-4996-bc66-b04276f3e914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:30.778145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1177/2319] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:41:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:30.790168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:30.791892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:30.806668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d6a84-8815-4e3e-8cef-9a17fb0ca172 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:30.810321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:30.810972 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.811255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.811532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.819233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:30.820661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46859407-e160-4db6-b5d9-cc09692954a0 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:30.829269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1143/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:30.925456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.925886 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.926197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.927718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1178/2321] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:41:30.935204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa76c7-7999-4a2b-b636-d821963bcb05 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:30.935204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa76c7-7999-4a2b-b636-d821963bcb05 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:30.935204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa76c7-7999-4a2b-b636-d821963bcb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:30.954761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-52fa76c7-7999-4a2b-b636-d821963bcb05 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:30.956387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-52fa76c7-7999-4a2b-b636-d821963bcb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:30.978856 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1144/2322] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:41:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:30.989453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:30.992208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:31.012343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11531e94-8477-409d-8b9e-a696fc50963d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:31.016897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:31.017679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:31.017964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:31.018240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:31.030652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:31.032374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:31.045704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1179/2323] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:41:36.582160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:36.582724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:36.582724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:36.600974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] MFA Rules not processed for user `26738ea4f6d54d7d81f1ec5057c237ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:36.602220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:36.610011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1145/2324] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:37.606776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:37.608236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:37.691964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e27679-d3c1-4a60-8d59-c4bc65a9f355 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:37.699139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:37.699808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:37.700097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:37.700376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:37.702480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:37.715529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:37.717148 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:37.728407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1180/2325] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:37.732182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:37.742545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06851070-aa5b-4ef3-89ec-240f9a1b3dc5 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:37.747169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:37.748063 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:37.748511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:37.748945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:37.750950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:37.822028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:37.823910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73d781-1fae-48fb-9833-917114306ff7 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:37.834927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1146/2326] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:44.738698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:44.774890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:44.806464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fff8b-ce02-4105-820f-1ae5afa6ef2c service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:44.811947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:44.812815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:44.813096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:44.813392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] PATH_INFO: `/v3/users/3d0b564df8f44d2a9a23d08106a755b1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:44.814576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0b564df8f44d2a9a23d08106a755b1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:44.816538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:44.870469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0b564df8f44d2a9a23d08106a755b1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:44.880456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0b564df8f44d2a9a23d08106a755b1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:44.888430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0b564df8f44d2a9a23d08106a755b1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:44.889160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0b564df8f44d2a9a23d08106a755b1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:44.902113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0b564df8f44d2a9a23d08106a755b1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:44.908320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1181/2327] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:41:44 2022] DELETE /identity/v3/users/3d0b564df8f44d2a9a23d08106a755b1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:41:44.912907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5986d-7a69-444c-b78e-0592723c997a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:44.913456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5986d-7a69-444c-b78e-0592723c997a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:44.913553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5986d-7a69-444c-b78e-0592723c997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:44.930938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-48f5986d-7a69-444c-b78e-0592723c997a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:44.932858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-48f5986d-7a69-444c-b78e-0592723c997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.005641 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1147/2328] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:41:45.039796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:45.043481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.120647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e8125-f2fb-4137-8dd1-230a6b5fff91 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:45.125140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:45.126071 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.126470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.126756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.139768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:45.141247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:45.151952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1182/2329] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:45.650377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.650749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.651146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.670415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:45.671710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.683681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:45.685102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.704538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfd45-fafa-4331-b6af-e5368e2f8050 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:45.709599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:45.710490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.710776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.711051 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] PATH_INFO: `/v3/projects/9985e10996e14c01881168b78ada2c22` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.712344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9985e10996e14c01881168b78ada2c22)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:45.715096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:45.750081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1148/2330] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:41:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:45.764107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:45.767421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9985e10996e14c01881168b78ada2c22', 'request_id': 'req-fbabb73d-8097-46fa-92e4-954ed3841c8f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:45.774614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:45.776236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9985e10996e14c01881168b78ada2c22', 'request_id': 'req-fbabb73d-8097-46fa-92e4-954ed3841c8f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:45.776434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.782605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9985e10996e14c01881168b78ada2c22', 'request_id': 'req-fbabb73d-8097-46fa-92e4-954ed3841c8f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:45.792845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:45.798665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] The token cache is being invalidate because project 9985e10996e14c01881168b78ada2c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:41:45.798665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:45.799659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fbabb73d-8097-46fa-92e4-954ed3841c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:41:45.802515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1183/2331] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:41:45 2022] DELETE /identity/v3/projects/9985e10996e14c01881168b78ada2c22 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:41:45.807912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f30-2ce9-4c9d-973c-0acca5106fd3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.808196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f30-2ce9-4c9d-973c-0acca5106fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.808471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f30-2ce9-4c9d-973c-0acca5106fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.827106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-50e13f30-2ce9-4c9d-973c-0acca5106fd3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:45.828327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-50e13f30-2ce9-4c9d-973c-0acca5106fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.853089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323270-2d08-44f9-92b3-15b39cd3f37c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:45.889753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1184/2332] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:41:45.898701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.898955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.899227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.917856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:45.919059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.921086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:45.921788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.922072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.922346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.924150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:45.931162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1185/2333] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:45.932119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:45.941908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d19b4-cc76-4139-ad27-8d4df8ede0c1 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:45.946881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:45.947532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.947849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.948119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.948913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:41:45.949239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:45.950814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:45.966255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1186/2334] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:41:45.970063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:45.983283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9672e3-717c-49db-bef2-c2a9ebfd7f6c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:45.988161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:45.988814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:45.989093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:45.989396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:45.990080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:45.991990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.005561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.007178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.017399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1149/2335] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 23:41:46.018648 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1187/2336] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:41:45 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:41:46.022724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:46.034435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4dde2-2531-4296-8fa5-fcaf1be364eb service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:46.103208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:46.125918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:46.127213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.128127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.128498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.130437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.134615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.178243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1150/2337] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:41:46 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:41:46.186121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:46.201028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6db90f-2c75-4f9b-9f3f-d9c88fed4abb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:46.206369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:46.207107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.207436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.207783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.208660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.210693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.224378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1188/2338] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:41:46.228690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:46.249090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c35ec-5fca-4c80-b189-b24c994323bf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:46.255434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:46.256396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.256685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.256962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.257802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.259640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bc9de-9f04-4da9-80d3-6b4bfe59c149 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.276290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1151/2339] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:41:46.280766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:46.292250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb9d8-b8ef-44e2-b8f2-356e8f506878 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:46.298046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:46.299692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.299979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.300378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] PATH_INFO: `/v3/projects/5228558ec9a64a85805ec8b494b593e2/users/f4ef25a80c804da79e3cf535a0b7e2a9/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.322259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5228558ec9a64a85805ec8b494b593e2, user_id=f4ef25a80c804da79e3cf535a0b7e2a9, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.325615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.360296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1189/2340] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:41:46 2022] PUT /identity/v3/projects/5228558ec9a64a85805ec8b494b593e2/users/f4ef25a80c804da79e3cf535a0b7e2a9/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:41:46.361614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.361875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.362231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.414431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] MFA Rules not processed for user `f4ef25a80c804da79e3cf535a0b7e2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:41:46.415888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:46.534299 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1152/2341] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:41:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:41:46.545701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:41:46.547728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:41:46.674514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b039-7db6-4454-94f9-8409e8985a89 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:41:46.678543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:41:46.679420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:41:46.679771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:41:46.680047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:41:46.690788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:41:46.693221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168c71e-a54d-4f0e-89a3-03093facc01a service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:41:46.700417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:41:46.709276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1190/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:41:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:41:56.524904 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:06.126398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:42:06.211720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cedae-8ada-4b9e-a4e2-da9430927f8f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:42:06.217149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:42:06.218169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:06.218456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:06.218730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] PATH_INFO: `/v3/users/f4ef25a80c804da79e3cf535a0b7e2a9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:06.219996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ef25a80c804da79e3cf535a0b7e2a9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:42:06.221983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:42:06.284071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ef25a80c804da79e3cf535a0b7e2a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.297742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ef25a80c804da79e3cf535a0b7e2a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.306451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ef25a80c804da79e3cf535a0b7e2a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.335699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ef25a80c804da79e3cf535a0b7e2a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.337123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ef25a80c804da79e3cf535a0b7e2a9'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.344423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1153/2343] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:42:06 2022] DELETE /identity/v3/users/f4ef25a80c804da79e3cf535a0b7e2a9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:42:06.350668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:06.351811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:06.352198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:06.383839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:42:06.386592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:06.451104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1191/2344] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:42:06.460881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:42:06.462360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:06.521624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14033-cc00-4e99-ab4c-ab8a5a20d7c6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:42:06.525387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:42:06.526133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:06.526447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:06.526731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:06.536656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:42:06.538138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:42:06.549258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1154/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:42:06.835235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:42:06.836577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:06.849298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4195-e158-4d7e-82b7-24e00951b27a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:42:06.860305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:42:06.861327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:06.861688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:06.862096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] PATH_INFO: `/v3/projects/5228558ec9a64a85805ec8b494b593e2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:06.864186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5228558ec9a64a85805ec8b494b593e2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:42:06.867065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:42:06.922089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5228558ec9a64a85805ec8b494b593e2', 'request_id': 'req-f50f04d3-f5be-462c-a950-6ab5bee9352a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.927661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5228558ec9a64a85805ec8b494b593e2', 'request_id': 'req-f50f04d3-f5be-462c-a950-6ab5bee9352a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.935297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5228558ec9a64a85805ec8b494b593e2', 'request_id': 'req-f50f04d3-f5be-462c-a950-6ab5bee9352a'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.959116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] The token cache is being invalidate because project 5228558ec9a64a85805ec8b494b593e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:42:06.959420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.960083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f50f04d3-f5be-462c-a950-6ab5bee9352a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:42:06.961785 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1192/2346] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:42:06 2022] DELETE /identity/v3/projects/5228558ec9a64a85805ec8b494b593e2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:42:08.962937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:42:08.974682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f325ed1-29cb-423d-808b-f765e0f359d7 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:42:09.000578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:09.046853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:42:09.047624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:09.047978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:09.048380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:09.050213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:09.119114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:42:09.120581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:42:09.130465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1155/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:42:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:42:10.998424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4d839-d57a-4221-9534-a71c052234a9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:10.999435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4d839-d57a-4221-9534-a71c052234a9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:10.999859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4d839-d57a-4221-9534-a71c052234a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:11.033105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-53f4d839-d57a-4221-9534-a71c052234a9 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:42:11.034509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-53f4d839-d57a-4221-9534-a71c052234a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:11.102828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1193/2348] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:42:11.116539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:42:11.117982 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:11.188503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb7f01-6b25-4a04-8543-20f062b8b4a7 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:42:11.193423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:42:11.194075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:11.194359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:11.194637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:11.204173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:42:11.205814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18291942-0597-4c7c-90a1-727897e4b060 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:42:11.214505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1156/2349] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:42:18.438329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7222d-ecf6-4dc2-9985-5d1acf71a364 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:18.438841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7222d-ecf6-4dc2-9985-5d1acf71a364 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:18.438939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7222d-ecf6-4dc2-9985-5d1acf71a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:18.457049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-56f7222d-ecf6-4dc2-9985-5d1acf71a364 None None] MFA Rules not processed for user `c44b88237c0f4ae7a31fbaaddbb2d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:42:18.458286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-56f7222d-ecf6-4dc2-9985-5d1acf71a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:18.482427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:18.515724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1194/2350] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:42:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:42:21.210775 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=72 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:28.508826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=12 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:42:35.901693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:42:35.902238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:42:35.902352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:42:35.919351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] MFA Rules not processed for user `b991805cfa834aab8dcab7d94d108ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:42:35.920592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:42:35.978068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1157/2351] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:42:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:42:45.971349 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=25 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:04.520772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:04.521317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:04.521425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:04.539464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] MFA Rules not processed for user `51def40a3de745a99f67c6ef2d2bcbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:04.540676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:04.596492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1195/2352] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:14.589674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=25 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:28.587791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:28.589233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:28.601485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd51eb1-e31e-4d42-b92d-bf8859e4dfa3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:28.605126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:28.605864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:28.606145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:28.606420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:28.608785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:28.684222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:28.685733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef007459-d28e-4295-a99c-5151d572a2c3 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:28.696959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1158/2353] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:29.872234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:29.874480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:29.886400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846ef0-3bed-42c6-87dc-fcb175ac0a26 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:29.890128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:29.890770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:29.891055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:29.891333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:29.893030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:29.906494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:29.907917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:29.918891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1196/2354] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:38.055502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:38.056014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:38.056014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:38.074835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] MFA Rules not processed for user `c44b88237c0f4ae7a31fbaaddbb2d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:38.076014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:38.083141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1159/2355] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:39.914040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:42.573658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:42.575307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:42.590077 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:42.591935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf0e1-5dcb-468d-aba4-a1c2a00d424d service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:42.598485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:42.599136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:42.599416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:42.599685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:42.601020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053917-76c4-4bb4-99b4-f0f2cda9128c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:42.601606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:42.604783 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:42.605456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:42.605917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:42.606360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:42.613092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:42.614986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:42.616296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:42.618706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:42.626868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1197/2356] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:42.638623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1160/2357] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:43:47.052129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:47.063521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b69b56-e8ce-4ade-822b-a6e52da423e6 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:47.069110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:47.069767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:47.070056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:47.070333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:47.072083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:47.082929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:47.084500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc54c0-76f5-40ea-a951-f1fb85953b50 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:47.094335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1198/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:52.624695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=43 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:54.222923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:54.233362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51c1c6-0ff8-4bea-a8c0-d4fe50d820f8 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:54.239204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:54.240429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:54.241205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:54.241695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:54.243791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:54.339442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:54.341227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0145e6d-44bd-4f9e-bd09-31fab8f6e11e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:54.357011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1161/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:57.089306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=12 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:58.026841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aeb69-8e00-48a1-aea6-0b0d86bde15b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.027416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aeb69-8e00-48a1-aea6-0b0d86bde15b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.028029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aeb69-8e00-48a1-aea6-0b0d86bde15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.065809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6f8aeb69-8e00-48a1-aea6-0b0d86bde15b None None] MFA Rules not processed for user `2768181f8a814902b8dcf50ce32907d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:58.067467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6f8aeb69-8e00-48a1-aea6-0b0d86bde15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.191900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1199/2360] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:58.242039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.242445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.242817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.244310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1162/2361] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:43:58.257415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.257705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.257990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.297045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] MFA Rules not processed for user `7a1a855f0a324f6b8a76bdbe18a04911`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:58.298516 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.382817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1200/2362] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:43:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:58.396509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:58.399275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.416064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:58.417884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.434155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33278ef-cba6-4615-8461-c12c9ed86841 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:58.436950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf3dd9-992b-4e03-a1cd-2b6f5ebed3e0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:58.442505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:58.444405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.444761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.445041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:58.445383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] PATH_INFO: `/v3/users/b991805cfa834aab8dcab7d94d108ee2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.445981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.446464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.446740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.447407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b991805cfa834aab8dcab7d94d108ee2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:58.449456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:58.456951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:58.458599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:58.470858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1201/2363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:43:58.508596 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b991805cfa834aab8dcab7d94d108ee2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.519444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b991805cfa834aab8dcab7d94d108ee2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.527005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b991805cfa834aab8dcab7d94d108ee2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.541383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b991805cfa834aab8dcab7d94d108ee2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.542101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b991805cfa834aab8dcab7d94d108ee2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.548236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1163/2364] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:43:58 2022] DELETE /identity/v3/users/b991805cfa834aab8dcab7d94d108ee2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:43:58.682446 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:58.694166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77043c19-d9b3-4cf5-9059-5c38bf67422a service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:58.751861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:58.752517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.752800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.753073 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.754891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.765642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:58.767236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7fdc8-af32-4e96-9f9b-2724a366f79c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:58.776607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1202/2365] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:43:58.794380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:58.796484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:58.867044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51682a87-93d9-452f-a75c-19500cfe28a8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:58.871632 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:58.872515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.872774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.873095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] PATH_INFO: `/v3/projects/79b6d71ecbf94b7a81761727712881ea` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:58.874342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b6d71ecbf94b7a81761727712881ea)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:58.876271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:58.884980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:58.935265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b6d71ecbf94b7a81761727712881ea', 'request_id': 'req-9c41a594-6933-46bb-a206-94989944f56e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.949333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b6d71ecbf94b7a81761727712881ea', 'request_id': 'req-9c41a594-6933-46bb-a206-94989944f56e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.959841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b6d71ecbf94b7a81761727712881ea', 'request_id': 'req-9c41a594-6933-46bb-a206-94989944f56e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.975041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] The token cache is being invalidate because project 79b6d71ecbf94b7a81761727712881ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:43:58.975339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.976034 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-9c41a594-6933-46bb-a206-94989944f56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:43:58.977839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1164/2366] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:43:58 2022] DELETE /identity/v3/projects/79b6d71ecbf94b7a81761727712881ea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:43:58.982883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6a6-b15a-46b6-abc0-e6e025499a66 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:58.983272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6a6-b15a-46b6-abc0-e6e025499a66 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:58.983555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e6a6-b15a-46b6-abc0-e6e025499a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.003635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-afd5e6a6-b15a-46b6-abc0-e6e025499a66 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:59.004492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.004831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-afd5e6a6-b15a-46b6-abc0-e6e025499a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.005219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.005779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.027231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:59.028379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.041520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:59.081438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1203/2367] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:43:59.090444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.090747 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.091017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.103660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1165/2368] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:59.127372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:59.129085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.148291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1204/2369] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:43:59.149319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.149567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.151791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.160503 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb490f9-830a-4978-8fda-d2eacc850113 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.166815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.171078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.171482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.171766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.172790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:43:59.173262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.174897 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.188235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1205/2370] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:43:59.189068 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.190774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.232831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31d6d-6d54-40cb-965c-04bf5ded4cfa None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.238232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.238877 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.239163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.239441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.241501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.253837 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.255552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.265610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1166/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:43:59.265821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e33ffc-729a-43dd-bea0-7ee0ab818f78 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.266446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.271777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.272599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.272956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.273339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.276630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dba09-e364-4502-9f03-c258882a96e4 service placement] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.282308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.282907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.283197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.283474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.284187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.286325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.286652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.288294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.298680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1206/2372] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:43:59.317324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1167/2373] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:43:59.321369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.333536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415378-bb4e-466f-b47d-126e8b49e52f service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.395399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.396274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.396700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.397636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.398208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.400322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.423859 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1207/2374] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:43:59.427767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.441052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a78583-5896-4d46-865f-54579bd4c823 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.448958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.450849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.452014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.452508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.453649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.455224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.457943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:59.472668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1168/2375] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:43:59.474284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.486103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2414b-b4c7-4cbe-b77f-b88da36dc54e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.492474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.493296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.493685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.493971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.494843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.496540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d7f5c-1a46-4e87-9de6-793a79d8627e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.508190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1208/2376] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:43:59.512649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.525798 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a5167-79fd-4575-96aa-c79a06f9e1db admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.531169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.532081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.532439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.532640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] PATH_INFO: `/v3/projects/ff14829a01504ac2898cf814e485acc7/users/9b8e64e0652d43a68dd62ef9944988c4/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.549727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff14829a01504ac2898cf814e485acc7, user_id=9b8e64e0652d43a68dd62ef9944988c4, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.552371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.569759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1169/2377] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:43:59 2022] PUT /identity/v3/projects/ff14829a01504ac2898cf814e485acc7/users/9b8e64e0652d43a68dd62ef9944988c4/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:43:59.581899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.582189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.582477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.618141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] MFA Rules not processed for user `9b8e64e0652d43a68dd62ef9944988c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:43:59.619376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:43:59.629468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:43:59.699759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1209/2378] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:43:59.704901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.784268 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad27e-af28-46dc-9887-faf13530265d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.789255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.789986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.790273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.790760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.791461 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.793450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.827821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1170/2379] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:43:59.829215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.841069 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efb953-aaa9-4baf-8f58-d0e6c7c0f3d7 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.907721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.907721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.908042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.908325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.909041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.911511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.937853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1210/2380] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:43:59 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:43:59.941022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.952857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a31b70-0570-4adc-9bd5-e03802de6ac7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.957765 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.958453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.958740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.959137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:43:59.959759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:43:59.961434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:43:59.975284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1171/2381] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:43:59.979702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:43:59.990983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca36d3-3f5e-4bce-9faf-4c8700fc6176 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:43:59.996154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:43:59.997155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:43:59.997544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:43:59.997950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] PATH_INFO: `/v3/projects/edfd402ef9c84e9c89363015fe3b35c7/users/b68d8645057349b5aca982f7a0707eed/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.021389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd402ef9c84e9c89363015fe3b35c7, user_id=b68d8645057349b5aca982f7a0707eed, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:00.024292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:00.039885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1211/2382] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:43:59 2022] PUT /identity/v3/projects/edfd402ef9c84e9c89363015fe3b35c7/users/b68d8645057349b5aca982f7a0707eed/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:00.043974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:00.055235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293bb2e-2be9-409a-adb1-bee840ed2e55 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:00.116802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:00.117536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:00.118326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:00.118326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.118816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:00.120420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf428d-a560-4d2b-9656-f2660455a50c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:00.131210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1172/2383] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:00.135398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:00.145828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e6942-07c2-405d-92ee-85d92214c4d5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:00.150464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:00.151357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:00.151637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:00.151911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] PATH_INFO: `/v3/projects/edfd402ef9c84e9c89363015fe3b35c7/users/b68d8645057349b5aca982f7a0707eed/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.153931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd402ef9c84e9c89363015fe3b35c7, user_id=b68d8645057349b5aca982f7a0707eed, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:00.157092 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:00.168086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1212/2384] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:00 2022] PUT /identity/v3/projects/edfd402ef9c84e9c89363015fe3b35c7/users/b68d8645057349b5aca982f7a0707eed/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:00.179633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:00.180050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:00.180736 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.213809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] MFA Rules not processed for user `b68d8645057349b5aca982f7a0707eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:00.215317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:00.278098 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:00.354336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1173/2385] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:00.370347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:00.372080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:00.440999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18dc2f-4b52-42a8-a248-813b4e118e0a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:00.446613 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:00.447556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:00.447891 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:00.448304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.461821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:00.463540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:00.481074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1213/2386] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:00.546354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:00.547816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:00.560563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d781af-0bb0-4f89-be95-c05640d42fdb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:00.564845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:00.565535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:00.565821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:00.566092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:00.639917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:00.641439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:00.652748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1174/2387] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:00.903155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:00.905307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:00.912550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:01.065292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdd9a0-d43c-44b7-a61f-84847ab45487 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:01.083961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:01.083961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:01.084307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:01.084639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:01.092934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:01.194367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:01.196699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:01.208684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1214/2388] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:02.133383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:02.136141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:02.269539 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa96ee-1eb9-4a5b-887d-ee6b596abd9e service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:02.274425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:02.275263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:02.275550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:02.275906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:02.281270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:02.294005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:02.295684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce08f-b458-43dc-bd57-ca21a0ffddca service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:02.318028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1175/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:04.412295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:04.478940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd4e22-84f6-4f34-b835-03cbd98c1955 service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:04.483766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:04.484647 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:04.484929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:04.485228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] PATH_INFO: `/v3/users/9b8e64e0652d43a68dd62ef9944988c4` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:04.486433 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8e64e0652d43a68dd62ef9944988c4)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:04.488373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:04.542555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:04.548903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8e64e0652d43a68dd62ef9944988c4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:04.558486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8e64e0652d43a68dd62ef9944988c4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:04.570001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8e64e0652d43a68dd62ef9944988c4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:04.570744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8e64e0652d43a68dd62ef9944988c4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:04.584729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8e64e0652d43a68dd62ef9944988c4'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:04.610285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1215/2390] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:04 2022] DELETE /identity/v3/users/9b8e64e0652d43a68dd62ef9944988c4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:04.613552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:04.614046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:04.614142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:04.641943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:04.643545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:04.712483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1176/2391] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:04.724093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:04.725607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:04.788218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92552e-6fdc-4e6b-acdd-5458f5524aeb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:04.791895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:04.792546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:04.792825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:04.793096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:04.803083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:04.804521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:04.815026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1216/2392] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:05.125428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:05.126907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:05.162832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7883-d876-43dd-84b6-d524b1a0bb8d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:05.169148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:05.170638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:05.170872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:05.171411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] PATH_INFO: `/v3/projects/ff14829a01504ac2898cf814e485acc7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:05.172541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff14829a01504ac2898cf814e485acc7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:05.174581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:05.182301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:05.234827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff14829a01504ac2898cf814e485acc7', 'request_id': 'req-36903a4c-3813-432b-b9a1-b2fe5847b2f1'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.242465 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff14829a01504ac2898cf814e485acc7', 'request_id': 'req-36903a4c-3813-432b-b9a1-b2fe5847b2f1'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.251978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff14829a01504ac2898cf814e485acc7', 'request_id': 'req-36903a4c-3813-432b-b9a1-b2fe5847b2f1'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.266825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] The token cache is being invalidate because project ff14829a01504ac2898cf814e485acc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:05.267551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.268480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.273510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1177/2393] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:05 2022] DELETE /identity/v3/projects/ff14829a01504ac2898cf814e485acc7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:05.274373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:05.284236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55a205-a10f-440a-85f4-328f038fd9b1 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:05.349247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:05.350377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:05.350562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:05.350838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] PATH_INFO: `/v3/users/b68d8645057349b5aca982f7a0707eed` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:05.352038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68d8645057349b5aca982f7a0707eed)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:05.353980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:05.401880 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68d8645057349b5aca982f7a0707eed'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.409998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68d8645057349b5aca982f7a0707eed'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.418228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68d8645057349b5aca982f7a0707eed'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.418924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68d8645057349b5aca982f7a0707eed'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.421011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:05.433819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-da19ecde-bf7b-412b-a1db-ef5477b3f0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68d8645057349b5aca982f7a0707eed'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.440933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1217/2394] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:05 2022] DELETE /identity/v3/users/b68d8645057349b5aca982f7a0707eed => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:05.767090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:05.768779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:05.792750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903a4c-3813-432b-b9a1-b2fe5847b2f1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:05.855341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:05.856218 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:05.856497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:05.856771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] PATH_INFO: `/v3/projects/edfd402ef9c84e9c89363015fe3b35c7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:05.858102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfd402ef9c84e9c89363015fe3b35c7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:05.861239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:05.914202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfd402ef9c84e9c89363015fe3b35c7', 'request_id': 'req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.921103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfd402ef9c84e9c89363015fe3b35c7', 'request_id': 'req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.930182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfd402ef9c84e9c89363015fe3b35c7', 'request_id': 'req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.945288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] The token cache is being invalidate because project edfd402ef9c84e9c89363015fe3b35c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:05.945583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.946715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2d4fc3a9-cec3-4169-87e9-a41ce31eb97c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:05.948864 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1178/2395] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:05 2022] DELETE /identity/v3/projects/edfd402ef9c84e9c89363015fe3b35c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:05.954314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:05.954845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:05.955127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:05.974562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:05.976099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:06.043740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1218/2396] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:06.051686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.051946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.052594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.074105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:06.075334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:06.085136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1179/2397] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:06.094914 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.103913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505dd0a2-6080-4bc6-9e17-2331340c0b1b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.120798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.123270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.123811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.124330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.125329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:44:06.125847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.128038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.143548 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1219/2398] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:44:06.148247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.168931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349d02-61d4-46ee-86fa-1f96b3c1b88e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.184252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.185842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.186320 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.186782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.188011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.190995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.227672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:06.256484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1180/2399] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:06.260403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.274030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acddfff-0e84-4862-bd93-759fbe163f87 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.367875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.368622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.368909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.369211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.369977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.373464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.412868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1220/2400] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:06.416718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.434853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512925a7-6fbe-415d-a44f-e471ecc7c57f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.451626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.452295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.452599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.452976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.453782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.459712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.472761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1181/2401] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:06.477104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.491307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3aa0e7-d79d-4049-9795-beadd9a69567 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.497412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.499330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.499615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.499890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.500621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.502395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb78c0-f5ce-492a-8fae-c1c35c8bcfe4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.513748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1221/2402] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:06.518046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.531549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a6e14-3dae-4176-b21b-4b260c804cd2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.536294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.537130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.537481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.537753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] PATH_INFO: `/v3/projects/156449151c334eb0861606596ffa0a3a/users/0cdd92445c3c4b808ae73837a4a5c125/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.555638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156449151c334eb0861606596ffa0a3a, user_id=0cdd92445c3c4b808ae73837a4a5c125, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.558509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.573265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1182/2403] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:06 2022] PUT /identity/v3/projects/156449151c334eb0861606596ffa0a3a/users/0cdd92445c3c4b808ae73837a4a5c125/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:06.583866 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.584430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.584724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.630367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] MFA Rules not processed for user `0cdd92445c3c4b808ae73837a4a5c125`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:06.631806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:06.694956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:06.737455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1222/2404] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:06.738950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.828627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4ab4-87d5-4a07-a6f7-6e043b98f0a9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.833408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.834067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.834347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.834642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.835325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.837301 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.865028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1183/2405] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:06.869467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.880942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760fa0-8c09-423f-b1f6-2228d075248a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.939953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.940638 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.940933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.941228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.941935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.943865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:06.967459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1223/2406] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:06 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:06.968690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:06.979923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290392d-8bf3-49ee-9d2d-06b8f486284e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:06.984957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:06.985655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:06.985941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:06.986216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:06.986940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:06.988537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.000054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1184/2407] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:07.004318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.015238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2150db8-073a-4043-8c05-fa6400508f85 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:07.019966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:07.020920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.021332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.021680 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] PATH_INFO: `/v3/projects/3d7c5a7acb944837a392e40d5c6209bf/users/db7b6492af03492ca23ea210f42238fa/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.037710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7c5a7acb944837a392e40d5c6209bf, user_id=db7b6492af03492ca23ea210f42238fa, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:07.040353 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.057203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1224/2408] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:07 2022] PUT /identity/v3/projects/3d7c5a7acb944837a392e40d5c6209bf/users/db7b6492af03492ca23ea210f42238fa/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:07.062315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.094259 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf179df-19ea-4194-91f2-4be2d0975928 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:07.166955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:07.167627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.167908 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.168183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.168928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:07.171251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7026-3368-4672-a7de-a3fdb4905b71 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.182725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1185/2409] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:07.187576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.198690 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb5538-5495-4844-9d21-f903d363f077 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:07.204720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:07.205977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.206413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.206874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] PATH_INFO: `/v3/projects/3d7c5a7acb944837a392e40d5c6209bf/users/db7b6492af03492ca23ea210f42238fa/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.209804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7c5a7acb944837a392e40d5c6209bf, user_id=db7b6492af03492ca23ea210f42238fa, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:07.213992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.229233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1225/2410] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:07 2022] PUT /identity/v3/projects/3d7c5a7acb944837a392e40d5c6209bf/users/db7b6492af03492ca23ea210f42238fa/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:07.238709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.239289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.239289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.266762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] MFA Rules not processed for user `db7b6492af03492ca23ea210f42238fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:07.267977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:07.287839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:07.374251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1186/2411] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:07.392341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.394669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:07.468922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cdba2-a355-4cdb-b00f-41765d88cdfd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:07.474179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:07.474843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.475126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.475406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.485578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:07.487654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42029dca-b483-44a1-96b1-d766372aab6d service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.505240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1226/2412] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:07.679463 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.757839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840f0da-a24a-4df5-bfd7-8672a4bffaa7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:07.762566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:07.764981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.765464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.765892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] PATH_INFO: `/v3/users/0cdd92445c3c4b808ae73837a4a5c125` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.767429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdd92445c3c4b808ae73837a4a5c125)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:07.769658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:07.838179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdd92445c3c4b808ae73837a4a5c125'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:07.848073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdd92445c3c4b808ae73837a4a5c125'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:07.856142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdd92445c3c4b808ae73837a4a5c125'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:07.879532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdd92445c3c4b808ae73837a4a5c125'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:07.880558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdd92445c3c4b808ae73837a4a5c125'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:07.890524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1187/2413] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:07 2022] DELETE /identity/v3/users/0cdd92445c3c4b808ae73837a4a5c125 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:07.895411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:07.895728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:07.896120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:07.914616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:07.915837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:07.947004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:07.989391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1227/2414] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:07.993537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:07.994987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:08.039518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:08.041507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:08.054920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:08.055831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb53aaf-98d1-4897-a30c-d43309639104 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.061684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.062566 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.062853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.063142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] PATH_INFO: `/v3/users/33ffdc9526374a07b696f5cc59b22ef7` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.064360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ffdc9526374a07b696f5cc59b22ef7)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.066355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.072772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685cf5-99f4-4ec2-9dcf-f5a621fd093d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.077235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.077884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.078172 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.078453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.088549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.096253 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.123747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1188/2415] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:08.143617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ffdc9526374a07b696f5cc59b22ef7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.155861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ffdc9526374a07b696f5cc59b22ef7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.179110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ffdc9526374a07b696f5cc59b22ef7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.180166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ffdc9526374a07b696f5cc59b22ef7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.199255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ffdc9526374a07b696f5cc59b22ef7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.208307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1228/2416] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:08 2022] DELETE /identity/v3/users/33ffdc9526374a07b696f5cc59b22ef7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:08.434351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:08.448653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f5d25-5d8a-4f38-a905-55c7165f283d service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.476049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:08.478533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:08.523835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.525173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.525489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.525785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] PATH_INFO: `/v3/projects/235634c0fcf14ebeab084cfca36d394b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.527630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235634c0fcf14ebeab084cfca36d394b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.530383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.555216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91103-b47d-4a97-8de4-93abd8fdf0bc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.561008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.562018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.562339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.562686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] PATH_INFO: `/v3/projects/156449151c334eb0861606596ffa0a3a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.564089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=156449151c334eb0861606596ffa0a3a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.566176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.584542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235634c0fcf14ebeab084cfca36d394b', 'request_id': 'req-2a172b3e-252b-4a6a-9eda-6d883104edd6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.591680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235634c0fcf14ebeab084cfca36d394b', 'request_id': 'req-2a172b3e-252b-4a6a-9eda-6d883104edd6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.601606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235634c0fcf14ebeab084cfca36d394b', 'request_id': 'req-2a172b3e-252b-4a6a-9eda-6d883104edd6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.616583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] The token cache is being invalidate because project 235634c0fcf14ebeab084cfca36d394b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:08.616936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.617673 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.619488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1189/2417] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:08 2022] DELETE /identity/v3/projects/235634c0fcf14ebeab084cfca36d394b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:08.622060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:08.623582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156449151c334eb0861606596ffa0a3a', 'request_id': 'req-debc9d71-92ab-428c-999f-5165765bdadf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.623876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:08.625947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:08.630645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156449151c334eb0861606596ffa0a3a', 'request_id': 'req-debc9d71-92ab-428c-999f-5165765bdadf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.639636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156449151c334eb0861606596ffa0a3a', 'request_id': 'req-debc9d71-92ab-428c-999f-5165765bdadf'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.654700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] The token cache is being invalidate because project 156449151c334eb0861606596ffa0a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:08.655317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.656383 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.661386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1229/2418] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:08 2022] DELETE /identity/v3/projects/156449151c334eb0861606596ffa0a3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:08.662783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:08.664633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:08.705639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172b3e-252b-4a6a-9eda-6d883104edd6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.724768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:08.762107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc9d71-92ab-428c-999f-5165765bdadf admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:08.768136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.769418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.769704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.769984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] PATH_INFO: `/v3/users/db7b6492af03492ca23ea210f42238fa` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.770548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:08.771194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7b6492af03492ca23ea210f42238fa)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.771429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:08.771719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:08.771993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] PATH_INFO: `/v3/users/346d46d2dd5c46b1b4475579a2a8a5a6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:08.773126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.773371 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346d46d2dd5c46b1b4475579a2a8a5a6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:08.775848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:08.833948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346d46d2dd5c46b1b4475579a2a8a5a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.834567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7b6492af03492ca23ea210f42238fa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.843343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346d46d2dd5c46b1b4475579a2a8a5a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.845953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7b6492af03492ca23ea210f42238fa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.851898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346d46d2dd5c46b1b4475579a2a8a5a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.856064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7b6492af03492ca23ea210f42238fa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.857407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7b6492af03492ca23ea210f42238fa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.869946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346d46d2dd5c46b1b4475579a2a8a5a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.870772 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346d46d2dd5c46b1b4475579a2a8a5a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.875569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7b6492af03492ca23ea210f42238fa'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:08.878979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1190/2419] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:08 2022] DELETE /identity/v3/users/346d46d2dd5c46b1b4475579a2a8a5a6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:08.883844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1230/2420] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:08 2022] DELETE /identity/v3/users/db7b6492af03492ca23ea210f42238fa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:09.072139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.073740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:09.155959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f41c3-0c75-41bb-88f6-cc8bd3094486 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.182082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.183585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:09.204069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.224142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.225003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.225312 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.225587 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] PATH_INFO: `/v3/projects/06620d963bdd4e86b2b1f406f36f96cc` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.227169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06620d963bdd4e86b2b1f406f36f96cc)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.229285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.258327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.265682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa23653-fa4f-49ea-b912-f86e23eaa41a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.282051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06620d963bdd4e86b2b1f406f36f96cc', 'request_id': 'req-0341a35d-1aa5-47ba-b68d-d48c6168170a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.287459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06620d963bdd4e86b2b1f406f36f96cc', 'request_id': 'req-0341a35d-1aa5-47ba-b68d-d48c6168170a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.296016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06620d963bdd4e86b2b1f406f36f96cc', 'request_id': 'req-0341a35d-1aa5-47ba-b68d-d48c6168170a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.309297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] The token cache is being invalidate because project 06620d963bdd4e86b2b1f406f36f96cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:09.309590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.311411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0341a35d-1aa5-47ba-b68d-d48c6168170a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.312966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1191/2421] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:09 2022] DELETE /identity/v3/projects/06620d963bdd4e86b2b1f406f36f96cc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:09.340422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.342145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.342375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.342701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] PATH_INFO: `/v3/projects/3d7c5a7acb944837a392e40d5c6209bf` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.344060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7c5a7acb944837a392e40d5c6209bf)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.346127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.409235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7c5a7acb944837a392e40d5c6209bf', 'request_id': 'req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.416545 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7c5a7acb944837a392e40d5c6209bf', 'request_id': 'req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.424766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7c5a7acb944837a392e40d5c6209bf', 'request_id': 'req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.441763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] The token cache is being invalidate because project 3d7c5a7acb944837a392e40d5c6209bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:09.442086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.442753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-667cdb4a-1e3e-4dd7-bfd9-3a8b0eb6e9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:09.445276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1231/2422] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:09 2022] DELETE /identity/v3/projects/3d7c5a7acb944837a392e40d5c6209bf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:09.449958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af559-3b51-4458-9354-2d2df822906f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.450377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af559-3b51-4458-9354-2d2df822906f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.451492 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94af559-3b51-4458-9354-2d2df822906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.473774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a94af559-3b51-4458-9354-2d2df822906f None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:09.475119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a94af559-3b51-4458-9354-2d2df822906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:09.557602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1192/2423] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:09.567804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.568377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.568377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.589578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:09.590812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:09.600368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1232/2424] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:09.604781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af559-3b51-4458-9354-2d2df822906f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.615111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94af559-3b51-4458-9354-2d2df822906f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.620109 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.620778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.621064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.621375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.622110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:44:09.622447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.624095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.636081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1193/2425] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:44:09.641735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.651664 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26413a-30ab-4c6a-b8fe-225a3b01cf47 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.657793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.658458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.658753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.659009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.659705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.661705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.693222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1233/2426] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:09.694505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.705342 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6bce3-a954-479c-9525-81e9f08c0294 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.767394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.768072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.768356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.768636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.769368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.771270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.777931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:09.792834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1194/2427] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:09 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:09.797823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.808270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e592d8e-575a-48fc-b6b1-89a8a8003713 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.814661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.815322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.815605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.815933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.816705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.818688 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.831782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1234/2428] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:09.835804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.846675 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef487259-bb6a-4fe2-a739-2d1158e71c0b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.851599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.852276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.852562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.852846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.853609 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.855249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb56577-9aad-4a5c-820b-2ce58e8cbc06 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.867689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1195/2429] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:09.869945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:09.880699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401b3b-87e8-4040-b807-bea7fbfedf58 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:09.885816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:09.886904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.887187 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.887468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] PATH_INFO: `/v3/projects/dafddcd326f149d483b9ff93694f76f4/users/7ceec138086c46e0b8578ce63b65fc72/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.903094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafddcd326f149d483b9ff93694f76f4, user_id=7ceec138086c46e0b8578ce63b65fc72, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:09.909118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:09.928195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1235/2430] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:09 2022] PUT /identity/v3/projects/dafddcd326f149d483b9ff93694f76f4/users/7ceec138086c46e0b8578ce63b65fc72/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:09.939493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:09.939493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:09.939763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:09.972180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] MFA Rules not processed for user `7ceec138086c46e0b8578ce63b65fc72`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:09.973456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:10.048661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1196/2431] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:10.053171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.098552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:10.137159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8221b-698a-4eb4-a847-c0b1ae47834c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.142793 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.143462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.143777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.144055 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.144771 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.146719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.172865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1236/2432] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:10.176923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.188607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0cc77-4479-4b91-a9ed-bf04208d91b4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.245850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.246557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.246866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.247137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.247959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.249944 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.269955 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1197/2433] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:10.274560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.285244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19619-8a10-4c96-aebb-adfa7564f9f0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.289974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.290642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.290932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.291210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.291942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.293590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.306301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1237/2434] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:10.310496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.322057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631aebc6-170e-426f-9c4f-ef27778f7ece admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.327624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.328381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.335119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.339215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.339996 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.342650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01f19-4bdf-4372-bde0-666fa5a63551 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.358528 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1198/2435] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:10.360112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.370644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049940-74aa-47ab-9d3b-1ead2b726455 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.375569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.376455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.376740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.377020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] PATH_INFO: `/v3/projects/d4c81667b0a640fc9267adeefa11125b/users/540f8f93a1834ecfa2f85535eb368812/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.392624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4c81667b0a640fc9267adeefa11125b, user_id=540f8f93a1834ecfa2f85535eb368812, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.395323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.409773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1238/2436] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:10 2022] PUT /identity/v3/projects/d4c81667b0a640fc9267adeefa11125b/users/540f8f93a1834ecfa2f85535eb368812/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:10.420230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.420605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.420981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.448792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] MFA Rules not processed for user `540f8f93a1834ecfa2f85535eb368812`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:10.450050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:10.487580 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:10.520458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1199/2437] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:10.525309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.592192 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.593743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:10.603909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b80ba-c516-4d9f-a0b0-f420d6443211 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.608744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.609448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.609739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.610021 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.610918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.612815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.641551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1239/2438] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:10.646181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.690719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88e37-588a-4883-ba3a-7d12f4758f86 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.715332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ff8e-2224-46de-9f6b-df77f856de4c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.720532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.721275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.721558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.721838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.722543 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.724684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.733529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:10.749153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1240/2439] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:10.752692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.763739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7277ecc-6ac4-4aa3-b40c-4abbb8112ef2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.770230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.770983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.771337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.771684 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.772491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.774192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.775279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.776012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.776396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.776770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.778787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:10.789493 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1241/2440] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:44:10.790520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.793639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.795423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.802059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb187d6a-25a8-4d80-a013-36f8b95bfba2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.806868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.807044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1200/2441] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:10.807640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.807944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.808227 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] PATH_INFO: `/v3/projects/b7c909b789af409c8ac4d063506aeef7/users/e0239e02f96c496097c2cc4ee4dbdff1/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.825334 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c909b789af409c8ac4d063506aeef7, user_id=e0239e02f96c496097c2cc4ee4dbdff1, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.828744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.847983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1242/2442] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:10 2022] PUT /identity/v3/projects/b7c909b789af409c8ac4d063506aeef7/users/e0239e02f96c496097c2cc4ee4dbdff1/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:10.849323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.861021 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d41991-0ecf-41cd-90c3-c442f023c52c service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.928651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.929537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.929960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.930295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.931168 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.933013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9c576-3e8f-43db-b0f6-5b2180c1efcf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.934515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:10.948830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1201/2443] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:10.950059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:10.961898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f834b-4041-4cae-a0b2-8af8acc018d5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:10.966662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:10.967562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.967977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.968261 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] PATH_INFO: `/v3/projects/b7c909b789af409c8ac4d063506aeef7/users/e0239e02f96c496097c2cc4ee4dbdff1/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:10.970306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c909b789af409c8ac4d063506aeef7, user_id=e0239e02f96c496097c2cc4ee4dbdff1, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:10.973087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:10.994964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1243/2444] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:10 2022] PUT /identity/v3/projects/b7c909b789af409c8ac4d063506aeef7/users/e0239e02f96c496097c2cc4ee4dbdff1/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:10.997374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:10.997857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:10.998173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:11.031504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] MFA Rules not processed for user `e0239e02f96c496097c2cc4ee4dbdff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:11.032878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:11.134396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1202/2445] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:11.149435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:11.151992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:11.219372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e595aa4-0e24-4bb6-8f4f-a3927b4ea21e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:11.222860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:11.223697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:11.223847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:11.224544 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:11.236893 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:11.238393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:11.252053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1244/2446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:11.293318 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:11.294998 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:11.307466 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977fc25-e43e-47d6-a346-ec2bfc96e176 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:11.311961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:11.312633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:11.312897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:11.313179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:11.402464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:11.404719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61722b-5c09-4577-bd77-83c46fef0249 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:11.414516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1203/2447] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:14.282250 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:14.347453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2a12a-89c5-4e34-9064-e00499582c88 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:14.351923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:14.352789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:14.353067 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:14.353369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] PATH_INFO: `/v3/users/7ceec138086c46e0b8578ce63b65fc72` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:14.354536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ceec138086c46e0b8578ce63b65fc72)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:14.356445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:14.401997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ceec138086c46e0b8578ce63b65fc72'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.404855 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:14.410192 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ceec138086c46e0b8578ce63b65fc72'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.418404 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ceec138086c46e0b8578ce63b65fc72'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.419052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ceec138086c46e0b8578ce63b65fc72'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.431117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ceec138086c46e0b8578ce63b65fc72'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.438084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1245/2448] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:14 2022] DELETE /identity/v3/users/7ceec138086c46e0b8578ce63b65fc72 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:14.442726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:14.443184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:14.443321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:14.460773 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:14.461994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:14.519771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1204/2449] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:14.529450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:14.530874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:14.587397 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35eb9b-4de4-40a6-8db6-b8c0b16f326b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:14.591127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:14.591768 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:14.592057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:14.592333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:14.602299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:14.603723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:14.613287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1246/2450] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:14.886793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:14.888317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:14.900781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49d2c4-8941-42c2-a2b4-30031a220420 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:14.905536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:14.906416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:14.906697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:14.906969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] PATH_INFO: `/v3/projects/dafddcd326f149d483b9ff93694f76f4` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:14.908169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafddcd326f149d483b9ff93694f76f4)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:14.910161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:14.927732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:14.962446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafddcd326f149d483b9ff93694f76f4', 'request_id': 'req-83804dea-e1d2-4393-9e9b-2710f5471627'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.968622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafddcd326f149d483b9ff93694f76f4', 'request_id': 'req-83804dea-e1d2-4393-9e9b-2710f5471627'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.977516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafddcd326f149d483b9ff93694f76f4', 'request_id': 'req-83804dea-e1d2-4393-9e9b-2710f5471627'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.992636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] The token cache is being invalidate because project dafddcd326f149d483b9ff93694f76f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:14.992932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.993630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:14.995169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1205/2451] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:14 2022] DELETE /identity/v3/projects/dafddcd326f149d483b9ff93694f76f4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:14.999904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:15.009358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a381b4-6568-439b-b312-28c23e8f6cc3 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:15.068377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:15.069285 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:15.069597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:15.069875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] PATH_INFO: `/v3/users/540f8f93a1834ecfa2f85535eb368812` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:15.071062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540f8f93a1834ecfa2f85535eb368812)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:15.072990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:15.121032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540f8f93a1834ecfa2f85535eb368812'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.128457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540f8f93a1834ecfa2f85535eb368812'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.135774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540f8f93a1834ecfa2f85535eb368812'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.136462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540f8f93a1834ecfa2f85535eb368812'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.143831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:15.149801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540f8f93a1834ecfa2f85535eb368812'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.157479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1247/2452] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:14 2022] DELETE /identity/v3/users/540f8f93a1834ecfa2f85535eb368812 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:15.424846 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:15.426402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:15.441969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804dea-e1d2-4393-9e9b-2710f5471627 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:15.498835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:15.499699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:15.499981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:15.500251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] PATH_INFO: `/v3/projects/d4c81667b0a640fc9267adeefa11125b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:15.501449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4c81667b0a640fc9267adeefa11125b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:15.503359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:15.549166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4c81667b0a640fc9267adeefa11125b', 'request_id': 'req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.554663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4c81667b0a640fc9267adeefa11125b', 'request_id': 'req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.561803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4c81667b0a640fc9267adeefa11125b', 'request_id': 'req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.573714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] The token cache is being invalidate because project d4c81667b0a640fc9267adeefa11125b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:15.574001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.574635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.576787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1206/2453] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:15 2022] DELETE /identity/v3/projects/d4c81667b0a640fc9267adeefa11125b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:15.580828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:15.582329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:15.595798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17205118-4b16-4dfe-a368-dafd3ce5be47 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:15.652964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:15.654473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:15.654709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:15.654987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] PATH_INFO: `/v3/users/e0239e02f96c496097c2cc4ee4dbdff1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:15.656186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0239e02f96c496097c2cc4ee4dbdff1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:15.658155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:15.705292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0239e02f96c496097c2cc4ee4dbdff1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.712420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0239e02f96c496097c2cc4ee4dbdff1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.719301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0239e02f96c496097c2cc4ee4dbdff1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.719932 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0239e02f96c496097c2cc4ee4dbdff1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.732141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6e4bad0a-f2b5-4b9d-9551-048c89c4996d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0239e02f96c496097c2cc4ee4dbdff1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:15.738095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1248/2454] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:15 2022] DELETE /identity/v3/users/e0239e02f96c496097c2cc4ee4dbdff1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:16.017229 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.018717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.031991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbbd60-8e7c-415c-a2a0-6bde6d459765 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.064062 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:16.096103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.097440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.098359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.098642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] PATH_INFO: `/v3/projects/b7c909b789af409c8ac4d063506aeef7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.099894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c909b789af409c8ac4d063506aeef7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.101869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.166390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c909b789af409c8ac4d063506aeef7', 'request_id': 'req-069316c3-9cff-46b6-94fe-489a7d72e0d2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:16.172969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c909b789af409c8ac4d063506aeef7', 'request_id': 'req-069316c3-9cff-46b6-94fe-489a7d72e0d2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:16.182050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c909b789af409c8ac4d063506aeef7', 'request_id': 'req-069316c3-9cff-46b6-94fe-489a7d72e0d2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:16.195439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] The token cache is being invalidate because project b7c909b789af409c8ac4d063506aeef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:16.195819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:16.196532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-069316c3-9cff-46b6-94fe-489a7d72e0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:16.198381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1207/2455] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:16 2022] DELETE /identity/v3/projects/b7c909b789af409c8ac4d063506aeef7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:16.204920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.205585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.205963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.226703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:16.228179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.293428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1249/2456] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:16.302663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.302949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.303309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.323619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:16.324844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.333001 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1208/2457] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:16.337491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.347789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11204b72-e350-462e-873f-b6fcd8260836 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.352668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.353464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.353818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.354161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.354963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:44:16.355343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.357742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.360938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:16.371216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1250/2458] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:44:16.376589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.386464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d02d61-3a78-413d-b130-ecde839909bc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.392027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.392681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.392960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.393269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.393956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.395857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.427136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1209/2459] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:16.430658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.442949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57455c46-aae9-4cb8-bb52-4658699aeb2e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.506163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.506844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.507129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.507406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.508305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.510325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.537204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1251/2460] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:16.538495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.552038 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe8c9d-92d6-4bff-a830-b49f7e2e2836 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.556706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.557409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.557691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.557964 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.558686 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.560523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.577230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1210/2461] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:16.579875 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.591947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4e9e-075b-402b-9eda-b5a72667af74 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.596666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.597474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.597832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.598119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.598978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.600651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05034b9-0aa0-40ad-aa1d-fb03f6caf9e1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.613520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1252/2462] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:16.618016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.628704 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be3db-eea8-4a42-b677-328b6c69eb2c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.635126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.636073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.637036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.637431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] PATH_INFO: `/v3/projects/ead4f403a7a44f339066a823742c5ecd/users/276be83f4d8f4b1e86570e64115ff820/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.656273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead4f403a7a44f339066a823742c5ecd, user_id=276be83f4d8f4b1e86570e64115ff820, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.660392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.678439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1211/2463] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:16 2022] PUT /identity/v3/projects/ead4f403a7a44f339066a823742c5ecd/users/276be83f4d8f4b1e86570e64115ff820/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:16.690941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613ab3-48a3-498a-82cf-e1e550480659 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.691235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613ab3-48a3-498a-82cf-e1e550480659 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.691517 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613ab3-48a3-498a-82cf-e1e550480659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.718232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-74613ab3-48a3-498a-82cf-e1e550480659 None None] MFA Rules not processed for user `276be83f4d8f4b1e86570e64115ff820`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:16.719452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-74613ab3-48a3-498a-82cf-e1e550480659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.792836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1253/2464] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:16.804672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.806531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.807970 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.808328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.808674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.827637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:16.828843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.876762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5cca8-254f-4ac7-b535-951441ae550d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.881262 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.882018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.882194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.882468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.892050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1254/2465] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:44:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:16.893974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.895544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:16.904060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.905472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:16.906091 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1212/2466] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:16.917445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:16.927353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:16.931659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:16.980270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d1fe1-f2dc-416a-aafd-3787d4379587 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:16.985975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:16.986754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:16.987044 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:16.987326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:16.995975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:16.998627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a8a91-0993-452e-bbc8-97ca7fc0d94a service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:17.006238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ecaf0-a80f-48b9-87c3-96e3ade79e1e service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:17.007075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1255/2467] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:44:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 23:44:17.011396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:17.012285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:17.012574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:17.012890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] PATH_INFO: `/v3/users/276be83f4d8f4b1e86570e64115ff820` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:17.014249 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] RBAC: Authorizing `identity:delete_user(user_id=276be83f4d8f4b1e86570e64115ff820)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:17.016173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:17.078653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276be83f4d8f4b1e86570e64115ff820'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.094850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276be83f4d8f4b1e86570e64115ff820'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.105288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276be83f4d8f4b1e86570e64115ff820'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.119910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276be83f4d8f4b1e86570e64115ff820'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.120649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276be83f4d8f4b1e86570e64115ff820'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.132238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1213/2468] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:16 2022] DELETE /identity/v3/users/276be83f4d8f4b1e86570e64115ff820 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:44:17.133961 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:17.134354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:17.134760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:17.154899 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:17.156286 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:17.227026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1256/2469] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:44:17.240480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:17.242579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:17.327137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df9c18-6682-41df-af66-632a553b314b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:17.333913 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:17.334787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:17.335240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:17.335683 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:17.354710 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:17.357714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2355473-78c3-4e8b-9671-26e670c36f48 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:17.374638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1214/2470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:17.766603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:17.772198 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:17.787016 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd0e93-4a50-40c6-8ed6-9268fa2ec902 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:17.792291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:17.793294 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:17.793759 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:17.794655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] PATH_INFO: `/v3/projects/ead4f403a7a44f339066a823742c5ecd` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:17.795994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead4f403a7a44f339066a823742c5ecd)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:17.798637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:17.857042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead4f403a7a44f339066a823742c5ecd', 'request_id': 'req-78701bba-7934-4e81-846f-576e8ae81aa2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.862815 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead4f403a7a44f339066a823742c5ecd', 'request_id': 'req-78701bba-7934-4e81-846f-576e8ae81aa2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.870468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead4f403a7a44f339066a823742c5ecd', 'request_id': 'req-78701bba-7934-4e81-846f-576e8ae81aa2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.889314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] The token cache is being invalidate because project ead4f403a7a44f339066a823742c5ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:17.889612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.890290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-78701bba-7934-4e81-846f-576e8ae81aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:17.892003 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1257/2471] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:17 2022] DELETE /identity/v3/projects/ead4f403a7a44f339066a823742c5ecd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:17.898054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:17.898570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:17.898753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:17.920796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:17.922779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:17.944984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:17.995402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1215/2472] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:44:18.002892 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.003183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.003464 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.028913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:18.030698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:18.039420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1258/2473] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:18.043690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.056330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccb51a-62cb-4c8e-aea8-d536cb058b9e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.062343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.063128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.063467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.065471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.066442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:44:18.066761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.068426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.082857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1216/2474] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:44:18.087302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.099561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6399-c2c1-4d40-b155-bc06767ed571 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.119145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.119928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.120316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.120658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.121484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.124228 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.144225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:18.172696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1259/2475] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:18 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:18.173977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.186978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87d9d-400d-4fc8-87a6-2475f3d79f3b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.266553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.267537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.268166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.268761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.269714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.272164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.304630 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1217/2476] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:18 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:18.304826 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.306574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:18.307395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.324821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2e0a6-19f8-4b07-b8ee-da9d3b9c27be admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.333156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.335761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.336297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.337047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.338183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.340347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.357549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1218/2477] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:18.359042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.371364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1ef22-3ab9-44b0-ad34-42a8e886d468 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.377637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.378585 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.379167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.379720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.380917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.382891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.400636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1219/2478] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:18.402177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.414216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b012e39-4dfa-4d41-9c90-66fd24577d63 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.429489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.430413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.430932 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.431239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] PATH_INFO: `/v3/projects/f179bb27bb3e4db3a1d2da25fd0eb8ae/users/e44277dbd6ed45139743f52e556dd739/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.452624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f179bb27bb3e4db3a1d2da25fd0eb8ae, user_id=e44277dbd6ed45139743f52e556dd739, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.454443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf1f2-f59d-4a68-a396-a01691421e78 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.455462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd365135-2455-4dad-bf70-c7b00190429c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.461618 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.462887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.463458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.464087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.469104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:18.472830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1220/2479] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:18 2022] PUT /identity/v3/projects/f179bb27bb3e4db3a1d2da25fd0eb8ae/users/e44277dbd6ed45139743f52e556dd739/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:18.483562 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.483943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.484302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.494145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.495876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.508763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1260/2480] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:18.530162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] MFA Rules not processed for user `e44277dbd6ed45139743f52e556dd739`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:18.531456 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:18.590304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:18.652666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1221/2481] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:18.665640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.667332 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:18.768064 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd663-76db-4e9d-8aa8-43d15758fafb service nova] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.827612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.828572 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.828858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.829139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.838760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.841699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6b76-be29-441b-96e3-81e6722c2db8 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:18.853265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1261/2482] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:18.881378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:18.963198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5c451-1fde-4643-bb59-68bd3f15a5e7 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:18.968915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:18.969830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:18.970116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:18.970397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] PATH_INFO: `/v3/users/e44277dbd6ed45139743f52e556dd739` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:18.971599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44277dbd6ed45139743f52e556dd739)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:18.973574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:19.032213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44277dbd6ed45139743f52e556dd739'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.043623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44277dbd6ed45139743f52e556dd739'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.052963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44277dbd6ed45139743f52e556dd739'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.068142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44277dbd6ed45139743f52e556dd739'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.069121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44277dbd6ed45139743f52e556dd739'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.075915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1222/2483] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:44:18 2022] DELETE /identity/v3/users/e44277dbd6ed45139743f52e556dd739 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:19.080597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:19.081113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:19.081536 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:19.114741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:19.116330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:19.156103 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:19.186975 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1262/2484] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:44:19.197285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:19.199140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:19.267449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe96cc9-93af-4c0b-b097-b3ca30aa9974 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:19.274233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:19.274940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:19.275322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:19.275603 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:19.286881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:19.288338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cb93c-2bf7-4031-865d-38b401c73eac service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:19.301112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1223/2485] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:19.635836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:19.637354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:19.682981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4cbc3-be33-488e-866e-b32a922af603 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:19.698527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:19.699796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:19.699986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:19.700610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] PATH_INFO: `/v3/projects/f179bb27bb3e4db3a1d2da25fd0eb8ae` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:19.702833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f179bb27bb3e4db3a1d2da25fd0eb8ae)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:19.707604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:19.780377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f179bb27bb3e4db3a1d2da25fd0eb8ae', 'request_id': 'req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.787783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f179bb27bb3e4db3a1d2da25fd0eb8ae', 'request_id': 'req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.796589 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f179bb27bb3e4db3a1d2da25fd0eb8ae', 'request_id': 'req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.814022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] The token cache is being invalidate because project f179bb27bb3e4db3a1d2da25fd0eb8ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:44:19.814372 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.815129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-51d9cb7d-8cdc-448a-81f3-88d5c38e97d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:44:19.816860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1263/2486] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:44:19 2022] DELETE /identity/v3/projects/f179bb27bb3e4db3a1d2da25fd0eb8ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:19.826032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:19.826493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:19.827339 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:19.865357 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:19.871324 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:19.873716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:19.957346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1224/2487] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:19.960025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:19.960273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:19.960443 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:19.983188 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:19.984563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:20.006867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1264/2488] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:20.007763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.033222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48325db-c003-412d-b441-b5b444bfe4c4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.038033 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.038916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.039045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.039246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.039976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:44:20.040286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.042055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.058743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1225/2489] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:44:20.061916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.077045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec261a-fa18-4574-9465-44ecc19bbf92 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.083960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.084631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.084908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.085208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.085939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.093734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.138326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1265/2490] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:20 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:20.144019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.157090 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8303419-83fa-4bd2-be99-817eaa390c71 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.237934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.238661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.238956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.239222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.240201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.244726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.288840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1226/2491] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:20 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:20.290014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.302634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde2ce2-0b78-4a72-9abb-a65e13384e12 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.314703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.315390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.315674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.315953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.316689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.318462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.339559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1266/2492] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:20.341845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.361204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24ae9f-e27a-4d26-acb5-90abdab6da87 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.367224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.367899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.368308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.368592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.369577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.371242 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d65905-c969-4fa8-a807-b8f0e0fd7f3a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.399621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1227/2493] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:20.403810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.414757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877de202-0fb2-45ea-a413-a2af2c49f8cd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.419716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.420607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.420888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.421163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] PATH_INFO: `/v3/projects/46779b270a484e19a7d9ede6406106d2/users/974e560b80084538929507528d1ea9de/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.439173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46779b270a484e19a7d9ede6406106d2, user_id=974e560b80084538929507528d1ea9de, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.442037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.461494 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1267/2494] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:20 2022] PUT /identity/v3/projects/46779b270a484e19a7d9ede6406106d2/users/974e560b80084538929507528d1ea9de/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:20.470881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.471207 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.471491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.493040 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:20.494316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:20.571945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1228/2495] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:20.582156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:20.584149 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:20.662318 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9b24f-eeb7-411a-aff0-7610210c90e2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:20.669756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:20.670928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:20.671378 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:20.671662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:20.683369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:20.685658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca820263-af7c-48a8-b3d9-ad98508d6f99 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:20.691831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:20.701674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1268/2496] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:23.173890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:23.175612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:23.222577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:23.345966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b14ed-86ca-4eb1-8386-c61330b26bd8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:23.352104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:23.352788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:23.353075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:23.353378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:23.355277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:23.381883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:23.383694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:23.403757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1229/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:25.252711 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d438f-01ab-4cd5-bc69-f0de8a1376c9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:25.253280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d438f-01ab-4cd5-bc69-f0de8a1376c9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:25.253380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d438f-01ab-4cd5-bc69-f0de8a1376c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:25.277302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-205d438f-01ab-4cd5-bc69-f0de8a1376c9 None None] MFA Rules not processed for user `26738ea4f6d54d7d81f1ec5057c237ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:25.279375 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-205d438f-01ab-4cd5-bc69-f0de8a1376c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:25.394265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1269/2498] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:25.865565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:25.877705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f581da-43c3-4b29-a0da-6fed60b67a10 service nova] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:25.889083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:25.889841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:25.890705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:25.891329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:25.894002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:25.912841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:25.914097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:25.939573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1230/2499] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:27.517106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:27.517654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:27.517773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:27.553078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] MFA Rules not processed for user `974e560b80084538929507528d1ea9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:27.554398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:27.734292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1270/2500] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:27.738958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:27.760088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91243e4e-bf27-4b29-a36b-dab6f4f29929 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:27.789351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:27.790511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:27.790805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:27.791085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:27.791809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:27.795042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:27.858314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1231/2501] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:44:27 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:44:27.859434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:27.884129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022daab2-7682-459e-a8e4-82f0bc08a86e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:27.979535 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:27.980364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:27.980656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:27.980962 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:27.981726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:27.990674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:28.033621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1271/2502] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:44:27 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:44:28.035561 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:28.052529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae36ebd-8841-4d80-b410-000bfe45512e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:28.070187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:28.071326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:28.071829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:28.072319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:28.073325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:28.076410 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:28.135189 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1232/2503] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:28.140448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:28.174268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377cee-dfe7-440c-b41a-12fb572cf1a6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:28.186118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:28.187369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:28.187652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:28.187928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] PATH_INFO: `/v3/projects/88b02f59005145a49a05978f60591123/users/0dc9cf6b59dc4133b7d48dcf405cba1c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:28.212484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b02f59005145a49a05978f60591123, user_id=0dc9cf6b59dc4133b7d48dcf405cba1c, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:28.214986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:28.231980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:28.245995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:28.246197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1272/2504] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:28 2022] PUT /identity/v3/projects/88b02f59005145a49a05978f60591123/users/0dc9cf6b59dc4133b7d48dcf405cba1c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:28.267149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2431603-fa44-42c0-8647-10856cc73a00 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:28.368576 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:28.369542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:28.370044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:28.370453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:28.371377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:28.374206 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c2f65-62db-475f-aecf-1b1621a5508a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:28.392804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:28.404200 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1233/2505] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:44:28.406458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d8b0-3abf-47fd-991e-3b9bf6403aca admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:28.415590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:28.415590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:28.415590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:28.415590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] PATH_INFO: `/v3/projects/88b02f59005145a49a05978f60591123/users/0dc9cf6b59dc4133b7d48dcf405cba1c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:28.417856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b02f59005145a49a05978f60591123, user_id=0dc9cf6b59dc4133b7d48dcf405cba1c, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:28.421357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:28.435606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1273/2506] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:44:28 2022] PUT /identity/v3/projects/88b02f59005145a49a05978f60591123/users/0dc9cf6b59dc4133b7d48dcf405cba1c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:44:35.718144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0550a7-704b-49fc-8d9c-551f158852a7 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:35.718725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0550a7-704b-49fc-8d9c-551f158852a7 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:35.718849 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0550a7-704b-49fc-8d9c-551f158852a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:35.749787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ab0550a7-704b-49fc-8d9c-551f158852a7 None None] MFA Rules not processed for user `0dc9cf6b59dc4133b7d48dcf405cba1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:35.751181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ab0550a7-704b-49fc-8d9c-551f158852a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:35.798624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:35.841226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1234/2507] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:35.851232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:35.853401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:35.944154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46cd07-ae95-447b-a07d-c9bce62357e2 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:35.951271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7524c2f848694708b1828c655383361c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:35.953065 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:35.953382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:35.953661 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:36.034873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:36.036780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17499da4-a3fc-48ee-8815-bc92bfc464cf service nova] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:36.050048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1274/2508] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:36.971916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:36.973010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:36.974690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] PATH_INFO: `/` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:36.977691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1235/2509] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:44:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:44:36.986666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93347bd8-bcdd-40cd-8f8f-c34110f2dac7 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:36.987296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93347bd8-bcdd-40cd-8f8f-c34110f2dac7 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:36.987296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93347bd8-bcdd-40cd-8f8f-c34110f2dac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.012877 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-93347bd8-bcdd-40cd-8f8f-c34110f2dac7 None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:37.014701 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-93347bd8-bcdd-40cd-8f8f-c34110f2dac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.031631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1275/2510] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:44:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:37.046743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:37.049071 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.179521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb828c-5bf3-47df-aeab-a742381d0548 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:37.184831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953c2242e2e047eca592608753cece82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:37.185618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.185910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.186185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.200536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:37.203653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134eeba-3649-4461-b82a-5d9db9d96620 service glance] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:37.218036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1236/2511] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:44:37.310217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfde9-eaa8-4815-a588-f8e790826e0f None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.310801 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfde9-eaa8-4815-a588-f8e790826e0f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.311396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfde9-eaa8-4815-a588-f8e790826e0f None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.313151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1276/2512] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:44:37.319827 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.320679 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.321214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.349365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] MFA Rules not processed for user `163fd72c29a54d5d977f0114cd9dab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:37.352356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.439743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1237/2513] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:44:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:44:37.441492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef756-0ecc-4392-aa9a-38cfec2097b9 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.442111 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef756-0ecc-4392-aa9a-38cfec2097b9 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.442653 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ef756-0ecc-4392-aa9a-38cfec2097b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.454542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:37.456467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.467478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b89ef756-0ecc-4392-aa9a-38cfec2097b9 None None] MFA Rules not processed for user `974e560b80084538929507528d1ea9de`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:37.469626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b89ef756-0ecc-4392-aa9a-38cfec2097b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.470721 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fab35-39fe-41b4-ae18-800c57a9fef8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:37.475676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:37.476002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.476292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.476570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.480121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1277/2514] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:44:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:37.486751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:37.488208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860804f8-d48b-4587-9a3d-8619f08d02b1 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:37.498252 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1238/2515] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:37.587615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee540-1159-4258-a22e-87747c35a850 None None] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.587904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee540-1159-4258-a22e-87747c35a850 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.588181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee540-1159-4258-a22e-87747c35a850 None None] PATH_INFO: `/` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.589621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1278/2516] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 23:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 23:44:37.596696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d5d9-b7fd-4b1e-85da-285f2d90613b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.597180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d5d9-b7fd-4b1e-85da-285f2d90613b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.597784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d5d9-b7fd-4b1e-85da-285f2d90613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.621403 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-a553d5d9-b7fd-4b1e-85da-285f2d90613b None None] MFA Rules not processed for user `7524c2f848694708b1828c655383361c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:37.622800 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-a553d5d9-b7fd-4b1e-85da-285f2d90613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:37.632598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1239/2517] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 23:44:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:37.644476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ee540-1159-4258-a22e-87747c35a850 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:37.664011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ee540-1159-4258-a22e-87747c35a850 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:37.669037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:37.669732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:37.670011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:37.670290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:37.682915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:37.684821 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:37.697974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1279/2518] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:44:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:44:41.428545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c404-a4f9-4c69-85c9-9072b596047d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:41.429037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c404-a4f9-4c69-85c9-9072b596047d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:41.429420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c404-a4f9-4c69-85c9-9072b596047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:41.448374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8e67c404-a4f9-4c69-85c9-9072b596047d None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:41.450294 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8e67c404-a4f9-4c69-85c9-9072b596047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:41.514097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1240/2519] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:44:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:41.527244 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:41.528847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:41.607036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:41.628913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d7434-44f0-462e-a4f0-3ab549ae415a service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:41.634610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:41.635273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:41.635654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:41.635810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:41.648531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:41.651606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:41.662260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1280/2520] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:44:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:44:51.504965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:51.657305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:44:58.770244 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:58.771084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:58.771391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:58.791106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:44:58.792307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:44:58.802139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1241/2521] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:44:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:44:58.820316 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:44:58.832116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d6882-32f3-490e-9e2e-d7daf2e138ca service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:44:58.838105 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:44:58.838852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:44:58.839131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:44:58.839702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:44:58.851379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:44:58.853554 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:44:58.864853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1281/2522] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:45:02.569394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:02.580128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c74723-2498-48af-9d2a-5cf0b5e356bf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:02.583739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:02.584382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:02.584662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:02.585166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:02.587129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:02.655738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:02.657271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:02.667500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1242/2523] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:06.046602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.048474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:06.063043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfaf7-696b-4ba1-b43a-8ec87c6c6b60 service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.067590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.068514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.068803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.069082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] PATH_INFO: `/v3/users/c44b88237c0f4ae7a31fbaaddbb2d427` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.070329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44b88237c0f4ae7a31fbaaddbb2d427)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.072255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.123243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44b88237c0f4ae7a31fbaaddbb2d427'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.130246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44b88237c0f4ae7a31fbaaddbb2d427'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.137305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44b88237c0f4ae7a31fbaaddbb2d427'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.138038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44b88237c0f4ae7a31fbaaddbb2d427'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.149831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-cca24961-120f-4660-bbe1-bffd9c1a1297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44b88237c0f4ae7a31fbaaddbb2d427'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.156312 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1282/2524] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:06 2022] DELETE /identity/v3/users/c44b88237c0f4ae7a31fbaaddbb2d427 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:06.332402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.344671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39982f-769f-4b29-afe6-10adf6470632 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.404605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.405503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.405791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.406067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] PATH_INFO: `/v3/projects/fc4faed5bed7450da8122eeb77459f3a` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.407243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4faed5bed7450da8122eeb77459f3a)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.409224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.454782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4faed5bed7450da8122eeb77459f3a', 'request_id': 'req-b87af575-2027-4aa6-a643-d579f596d7e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.460221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4faed5bed7450da8122eeb77459f3a', 'request_id': 'req-b87af575-2027-4aa6-a643-d579f596d7e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.467416 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4faed5bed7450da8122eeb77459f3a', 'request_id': 'req-b87af575-2027-4aa6-a643-d579f596d7e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.478257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] The token cache is being invalidate because project fc4faed5bed7450da8122eeb77459f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:06.478543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.479164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b87af575-2027-4aa6-a643-d579f596d7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:06.481333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1243/2525] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:06 2022] DELETE /identity/v3/projects/fc4faed5bed7450da8122eeb77459f3a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:06.486575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.486858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.487132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.504804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:06.506082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:06.566104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1283/2526] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:06.574052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.574346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.575411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.594883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:06.596085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:06.604020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1244/2527] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:06.608131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.618276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffbb4a-0941-4da3-b905-8f2d12f26f7b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.622991 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.623645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.623930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.624210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.624955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:06.625282 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.626927 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.639673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1284/2528] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:06.643748 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.654187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d46db-e133-47ba-9198-4d2b2c2e160d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.658966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.659627 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.659911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.660186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.660885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.662844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.671790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:06.691529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1245/2529] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:06 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:06.695459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.706644 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fee18e-7170-4b4f-84fb-24618d03d927 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.753396 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:06.769930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.770639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.770987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.771266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.772345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.773913 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.793906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1285/2530] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:06 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:06.798272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.808628 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725d743-74e2-4a44-a74f-8712ee683d43 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.814289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.814947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.815230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.815504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.816227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.817910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.828990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1246/2531] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:06.832881 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.842884 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde6c6-965b-4f7b-a4c9-479f8d623b55 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.847481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.848126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.848406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.848677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.849423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.850997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6ed4-dfe0-4f8b-961e-d96f2bf2ae59 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.860900 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1286/2532] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:06.865061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.875841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a4a0-32a4-4baa-b4f9-63c7fd53c50b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:06.880650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:06.881592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.881871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.882140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] PATH_INFO: `/v3/projects/9ba51a693944444fa22989ad78c38b14/users/c07df773a6944285bc2163bc82a41498/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.897934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba51a693944444fa22989ad78c38b14, user_id=c07df773a6944285bc2163bc82a41498, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:06.900568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:06.913295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1247/2533] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:06 2022] PUT /identity/v3/projects/9ba51a693944444fa22989ad78c38b14/users/c07df773a6944285bc2163bc82a41498/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:06.924233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:06.924527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:06.924838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:06.942087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:06.943760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:06.956988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] MFA Rules not processed for user `c07df773a6944285bc2163bc82a41498`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:06.958436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:07.009966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7f448-97c8-434f-af5b-178996ce5d7b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.015240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.015974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.016328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.016680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.018649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:07.041088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1287/2534] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:07.045767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.098346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.100256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.113313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206029-7f77-4a8c-ad8f-a18a6b1cb164 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.119296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.120042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.120390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.120731 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.122150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.123070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1248/2535] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:45:07.124377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.151944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1288/2536] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:07 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:07.156994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.167884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d1bdb-39e9-4825-9606-f8333d865a2e service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.225924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.226625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.226911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.227190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.227875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.229819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.243922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:07.250817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1249/2537] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:07 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:07.254752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.265695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbea8a-4b93-4896-9112-98c9dc036819 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.270639 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.271297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.271575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.271847 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.272568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.274185 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.286522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1289/2538] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:07.290563 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.300467 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1854a56-6619-4e4c-b8a1-92119e920b85 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.305018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.305934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.306220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.306498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] PATH_INFO: `/v3/projects/a0bb049965b54985b7fe13c3faaffdf0/users/113e5cd3d7864dc4876008281273dcda/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.321358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bb049965b54985b7fe13c3faaffdf0, user_id=113e5cd3d7864dc4876008281273dcda, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.323994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.337404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1250/2539] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:07 2022] PUT /identity/v3/projects/a0bb049965b54985b7fe13c3faaffdf0/users/113e5cd3d7864dc4876008281273dcda/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:07.342236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.352087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc21d3a-2caa-4b92-8bda-d35e0c373b27 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.378946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:07.412592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.413283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.413565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.413838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.414606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.416218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96358c83-5273-4e4a-80f3-5232389cce19 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.426032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1290/2540] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:07.430226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.440598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b231f-24cf-4593-8396-49525b9303c6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.445165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.446083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.446369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.446648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] PATH_INFO: `/v3/projects/a0bb049965b54985b7fe13c3faaffdf0/users/113e5cd3d7864dc4876008281273dcda/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.448631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bb049965b54985b7fe13c3faaffdf0, user_id=113e5cd3d7864dc4876008281273dcda, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.451914 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.461929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1251/2541] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:07 2022] PUT /identity/v3/projects/a0bb049965b54985b7fe13c3faaffdf0/users/113e5cd3d7864dc4876008281273dcda/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:07.472469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.472758 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.473036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.499348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] MFA Rules not processed for user `113e5cd3d7864dc4876008281273dcda`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:07.500553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:07.568515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1291/2542] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:07.579778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.581554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:07.638697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6e09-4311-4f4e-b2c1-25fbab486b28 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.642599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.643264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.643544 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.643817 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.652790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.654234 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e518c-bacf-40c8-a4a9-be99d38fba27 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.663569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1252/2543] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:07.799309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:07.861982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4cec0-b843-48b2-8aac-42aa30bdf35c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:07.867004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:07.867883 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.868165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.868438 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] PATH_INFO: `/v3/users/c07df773a6944285bc2163bc82a41498` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.869751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07df773a6944285bc2163bc82a41498)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:07.872211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:07.919804 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07df773a6944285bc2163bc82a41498'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:07.923420 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:07.926539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07df773a6944285bc2163bc82a41498'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:07.935415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07df773a6944285bc2163bc82a41498'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:07.936060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07df773a6944285bc2163bc82a41498'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:07.947715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07df773a6944285bc2163bc82a41498'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:07.954242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1292/2544] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:07 2022] DELETE /identity/v3/users/c07df773a6944285bc2163bc82a41498 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:07.958755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:07.959046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:07.959327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:07.977536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:07.978716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:08.038942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1253/2545] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:08.048824 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:08.050304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:08.107371 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035cb1-cbf7-470d-bd5a-dd8aae115e80 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:08.111043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:08.111704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:08.112157 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:08.112277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:08.122676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:08.124117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:08.134113 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1293/2546] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:08.503082 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:08.504592 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:08.519114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b4eac-7b8b-4750-9402-e516e5772ef8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:08.524854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:08.525819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:08.526099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:08.526369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] PATH_INFO: `/v3/projects/9ba51a693944444fa22989ad78c38b14` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:08.528638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba51a693944444fa22989ad78c38b14)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:08.531836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:08.592074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba51a693944444fa22989ad78c38b14', 'request_id': 'req-324064d7-6acc-4fd1-aa1e-229286c89746'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.599191 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba51a693944444fa22989ad78c38b14', 'request_id': 'req-324064d7-6acc-4fd1-aa1e-229286c89746'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.602834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:08.614538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba51a693944444fa22989ad78c38b14', 'request_id': 'req-324064d7-6acc-4fd1-aa1e-229286c89746'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.631135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] The token cache is being invalidate because project 9ba51a693944444fa22989ad78c38b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:08.631524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.632464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.634372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1254/2547] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:08 2022] DELETE /identity/v3/projects/9ba51a693944444fa22989ad78c38b14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:08.639117 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:08.649595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8aa91-69ae-43d5-98fc-4eedef908e8d service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:08.711257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:08.712258 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:08.712606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:08.712946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] PATH_INFO: `/v3/users/113e5cd3d7864dc4876008281273dcda` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:08.714257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=113e5cd3d7864dc4876008281273dcda)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:08.716870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:08.764723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113e5cd3d7864dc4876008281273dcda'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.774607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113e5cd3d7864dc4876008281273dcda'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.782780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113e5cd3d7864dc4876008281273dcda'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.783448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113e5cd3d7864dc4876008281273dcda'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.791179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:08.797315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-aad4513c-7416-4aef-8f74-5582a824f95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113e5cd3d7864dc4876008281273dcda'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:08.805156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1294/2548] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:08 2022] DELETE /identity/v3/users/113e5cd3d7864dc4876008281273dcda => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:09.086145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.087629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:09.104723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324064d7-6acc-4fd1-aa1e-229286c89746 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.166945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.167725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.168003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.168990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] PATH_INFO: `/v3/projects/a0bb049965b54985b7fe13c3faaffdf0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.170208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bb049965b54985b7fe13c3faaffdf0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.172123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.221205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bb049965b54985b7fe13c3faaffdf0', 'request_id': 'req-46b4daae-5dee-40f6-94e6-c2cf2e5af159'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:09.227195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bb049965b54985b7fe13c3faaffdf0', 'request_id': 'req-46b4daae-5dee-40f6-94e6-c2cf2e5af159'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:09.236434 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bb049965b54985b7fe13c3faaffdf0', 'request_id': 'req-46b4daae-5dee-40f6-94e6-c2cf2e5af159'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:09.258137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] The token cache is being invalidate because project a0bb049965b54985b7fe13c3faaffdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:09.258428 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:09.259245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-46b4daae-5dee-40f6-94e6-c2cf2e5af159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:09.261361 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1255/2549] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:09 2022] DELETE /identity/v3/projects/a0bb049965b54985b7fe13c3faaffdf0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:09.266425 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.267578 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.267725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.290310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:09.291907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:09.354906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1295/2550] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:09.363353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.363902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.364180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.383329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:09.384642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:09.394129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1256/2551] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:09.398311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.409218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ea8d9-aaf3-40af-aaf6-e5bacb42c90e None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.414621 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.415300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.415716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.415999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.416864 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:09.417252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.418876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.434428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1296/2552] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:09.438749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.448625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7adf3a-a65f-410f-8585-9ee9ca3a4e9a None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.454010 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.454667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.454950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.455224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.455924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.457867 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.487956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1257/2553] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:09 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:09.489518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.500734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89964-b5c9-4261-a76f-7b0c262206e5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.557715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.558419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.559467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.559890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.560592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.562559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.582346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1297/2554] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:09 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:09.586447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.596709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef329c-c19a-4f41-b104-1481ad7e6375 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.601213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.601862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.602145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.602419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.603162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.604730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.616059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1258/2555] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:09.620039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.631030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59346a51-9c45-4396-bf3a-c2a79e8e8f02 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.635708 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.636368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.636658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.637155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.637950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.639561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e6067-f6c6-440d-895a-406fb43aecd8 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.651305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1298/2556] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:09.655538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.665691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4bbd-3b90-4be0-a533-5f4d1867a6d0 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.671169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.671984 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.672264 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.672538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] PATH_INFO: `/v3/projects/50a22296e62746ce86158fee9055b3b1/users/3872552152a542dc936dc300140205bd/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.687027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a22296e62746ce86158fee9055b3b1, user_id=3872552152a542dc936dc300140205bd, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.689696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.702895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1259/2557] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:09 2022] PUT /identity/v3/projects/50a22296e62746ce86158fee9055b3b1/users/3872552152a542dc936dc300140205bd/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:09.707837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c91-e777-406d-a305-454ad5dfed9a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.708129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c91-e777-406d-a305-454ad5dfed9a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.708402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec7c91-e777-406d-a305-454ad5dfed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.725716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-acec7c91-e777-406d-a305-454ad5dfed9a None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:09.726942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-acec7c91-e777-406d-a305-454ad5dfed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:09.776559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:09.787162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1299/2558] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:09.796768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:09.798532 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:09.813351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:09.857694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27896536-26a6-416f-bccc-e1bc184681b3 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:09.861843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:09.862899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:09.863695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:09.864194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:09.877481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:09.878911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:09.889085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1260/2559] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:10.524625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:10.525153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:10.525153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:10.559181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] MFA Rules not processed for user `3872552152a542dc936dc300140205bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:10.562097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:10.673467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1300/2560] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:10.677690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:10.690618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7203e3-0a54-4040-881e-45d8e72894e9 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:10.695794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:10.696774 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:10.697232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:10.697646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:10.698990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:10.702497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:10.737504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1261/2561] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:10 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:10.741696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:10.776400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e395293-b7d5-4b93-b2a6-ce1733448f5a None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:10.862654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:10.863595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:10.863888 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:10.864160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:10.864867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:10.866825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:10.890451 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1301/2562] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:10 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:45:10.895039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:10.906445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83683835-a3c5-4748-905b-d477e73a6c20 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:10.912589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:10.913304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:10.913594 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:10.913880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:10.914633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:10.916399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:10.928364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1262/2563] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:10.932730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:10.944850 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdd2fe-9945-4d39-a335-e85ef69fd946 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:10.950254 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:10.951350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:10.951634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:10.951911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] PATH_INFO: `/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9/users/4d314d10d778428e95f26210291a6469/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:10.968169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6000bdf6c67a4f2680e03d0d7b4e2cc9, user_id=4d314d10d778428e95f26210291a6469, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:10.970861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:10.985302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1302/2564] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:10 2022] PUT /identity/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9/users/4d314d10d778428e95f26210291a6469/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:10.989614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:11.000130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf036800-0d82-49a4-8e81-3e9e39848272 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:11.056468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:11.057131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:11.057449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:11.057725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:11.058470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:11.060210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d8fb-a0b5-426f-932f-72def1b7e800 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:11.070742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1263/2565] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:11.075788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:11.088319 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8732-3afa-411b-9463-653b01d43a60 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:11.094685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:11.095721 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:11.096015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:11.096748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] PATH_INFO: `/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9/users/4d314d10d778428e95f26210291a6469/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:11.099434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6000bdf6c67a4f2680e03d0d7b4e2cc9, user_id=4d314d10d778428e95f26210291a6469, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:11.102159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:11.114982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1303/2566] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:11 2022] PUT /identity/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9/users/4d314d10d778428e95f26210291a6469/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:11.750504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:11.751018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:11.751130 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:11.778404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] MFA Rules not processed for user `4d314d10d778428e95f26210291a6469`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:11.779650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:11.859633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1264/2567] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:12.938869 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:12.940573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:12.984998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:13.005573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:13.011764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:13.021845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73d546-dee5-4167-a4a0-7850f885655f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:13.026844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:13.028135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:13.028990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:13.029297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:13.031088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:13.044427 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:13.046635 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:13.060138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1304/2568] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:13.086162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c80b76-42d4-463c-ae29-7f456d49ab22 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:13.100440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:13.101426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:13.101717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:13.101994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] PATH_INFO: `/v3/users/3872552152a542dc936dc300140205bd` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:13.103250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3872552152a542dc936dc300140205bd)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:13.105235 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:13.168285 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3872552152a542dc936dc300140205bd'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.178699 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3872552152a542dc936dc300140205bd'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.187073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3872552152a542dc936dc300140205bd'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.211830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3872552152a542dc936dc300140205bd'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.212858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3872552152a542dc936dc300140205bd'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.225048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1265/2569] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:13 2022] DELETE /identity/v3/users/3872552152a542dc936dc300140205bd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:13.462753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:13.486903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ba375-13e7-492c-b308-6e0a17fb637b service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:13.554041 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:13.554917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:13.555200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:13.555476 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] PATH_INFO: `/v3/projects/50a22296e62746ce86158fee9055b3b1` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:13.556662 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a22296e62746ce86158fee9055b3b1)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:13.557135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:13.559145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:13.559381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:13.606324 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a22296e62746ce86158fee9055b3b1', 'request_id': 'req-28cf1502-d946-4dfd-b503-8e214a7955a1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.612462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a22296e62746ce86158fee9055b3b1', 'request_id': 'req-28cf1502-d946-4dfd-b503-8e214a7955a1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.618161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2206c8c-5209-4897-9ea6-53db1559b784 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:13.619124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a22296e62746ce86158fee9055b3b1', 'request_id': 'req-28cf1502-d946-4dfd-b503-8e214a7955a1'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.633472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] The token cache is being invalidate because project 50a22296e62746ce86158fee9055b3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:13.633765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.634382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.636333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1305/2570] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:13 2022] DELETE /identity/v3/projects/50a22296e62746ce86158fee9055b3b1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:13.640946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:13.642565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:13.658489 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:13.670534 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:13.671335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:13.671657 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:13.671945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:13.673740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:13.709414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf1502-d946-4dfd-b503-8e214a7955a1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:13.714093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:13.715500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:13.715777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:13.716032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] PATH_INFO: `/v3/users/4d314d10d778428e95f26210291a6469` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:13.717278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d314d10d778428e95f26210291a6469)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:13.719270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:13.720955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:13.738969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:13.740443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:13.752389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1266/2571] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:45:13.768335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d314d10d778428e95f26210291a6469'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.777043 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d314d10d778428e95f26210291a6469'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.784772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d314d10d778428e95f26210291a6469'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.785522 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d314d10d778428e95f26210291a6469'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.801219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e7864426-dafe-4c80-a9e9-9c690c7c0bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d314d10d778428e95f26210291a6469'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:13.807366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1306/2572] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:13 2022] DELETE /identity/v3/users/4d314d10d778428e95f26210291a6469 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:13.994835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.006311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d1dcb-e289-48c2-8af9-3aeaf53569f3 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.069441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.070311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.070595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.070871 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] PATH_INFO: `/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.072072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6000bdf6c67a4f2680e03d0d7b4e2cc9)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.074041 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.135737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6000bdf6c67a4f2680e03d0d7b4e2cc9', 'request_id': 'req-8098f088-439a-4ac5-aae7-be9e76984c24'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:14.145388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6000bdf6c67a4f2680e03d0d7b4e2cc9', 'request_id': 'req-8098f088-439a-4ac5-aae7-be9e76984c24'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:14.155602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6000bdf6c67a4f2680e03d0d7b4e2cc9', 'request_id': 'req-8098f088-439a-4ac5-aae7-be9e76984c24'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:14.173148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] The token cache is being invalidate because project 6000bdf6c67a4f2680e03d0d7b4e2cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:14.173483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:14.174194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8098f088-439a-4ac5-aae7-be9e76984c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:14.176332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1267/2573] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:13 2022] DELETE /identity/v3/projects/6000bdf6c67a4f2680e03d0d7b4e2cc9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:14.180682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.181229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.181348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.201327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:14.202537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:14.271449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1307/2574] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:14.280221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.280514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.280797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.300392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:14.301652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:14.309654 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1268/2575] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:14.313925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.324508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db66051-c45e-420a-ba03-6da4576e482d None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.329225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.329925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.330208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.330487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.331249 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:14.331561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.333180 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.345606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1308/2576] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:14.349986 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.360149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac6ff4-3cd1-4d0e-87f4-751ac7da2c83 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.365170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.365850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.366179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.366615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.367321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.369261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.379708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:14.398225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1269/2577] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:14.402989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.413088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ae9dc-12f9-41ae-acf9-e51dad73b297 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.486411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.487336 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.487567 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.487844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.488874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.490882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.501583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:14.515702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1309/2578] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:14.519495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.531086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d89a0-8fb4-4847-a8c8-61644a24d0b1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.535782 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.536453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.536741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.537022 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.538051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.539653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.557223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1270/2579] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:14.559781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.571150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1161c-ae90-4971-b74e-333c1738591e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.576917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.577733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.578235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.578593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.579400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.581081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e405-fff7-4cac-8b70-be14c87f18f1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.592423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1310/2580] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:14.596598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.609306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae4a99-df32-4f09-99c0-6b59299e3720 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.614898 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.615868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.616225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.616573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] PATH_INFO: `/v3/projects/f34d5495e92d4a3984b19aec7eb8b1c4/users/774423c160ab44468fa2b83e5586d8e8/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.636060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34d5495e92d4a3984b19aec7eb8b1c4, user_id=774423c160ab44468fa2b83e5586d8e8, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.639277 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.657443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1271/2581] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:14 2022] PUT /identity/v3/projects/f34d5495e92d4a3984b19aec7eb8b1c4/users/774423c160ab44468fa2b83e5586d8e8/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:14.669141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.669468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.669746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.711350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] MFA Rules not processed for user `774423c160ab44468fa2b83e5586d8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:14.711350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:14.791194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1311/2582] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:14.796450 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.873977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c81db3-a271-46df-a8d6-152d19ed2fb4 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:14.878968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:14.879633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:14.879917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:14.880199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:14.880895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:14.882824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:14.918589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1272/2583] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:14.919973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:14.932407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1562-5af5-417f-87ec-cb236b84f4d0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.008805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.009683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.010066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.010445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.012930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.015219 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.037641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1312/2584] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:14 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:15.041840 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.053660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8628d-1af0-4d7d-be36-42853f200de1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.059068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.060533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.060879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.061258 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.062101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.064338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.082381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1273/2585] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:15.084230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.098273 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4551df8-2c2f-4468-97b5-548313ddb0c6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.103844 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.104750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.105168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.110795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] PATH_INFO: `/v3/projects/8efb2915f521487fa9543d636a8685ca/users/5ff9601ce5554a17bfe1a922be99c090/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.129086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efb2915f521487fa9543d636a8685ca, user_id=5ff9601ce5554a17bfe1a922be99c090, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.132042 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.149730 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1313/2586] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:15 2022] PUT /identity/v3/projects/8efb2915f521487fa9543d636a8685ca/users/5ff9601ce5554a17bfe1a922be99c090/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:15.156866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.167387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa121a9-3588-42bc-b78b-a32bdcb9cd46 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.225922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.226514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.226803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.227086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.227810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.230705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d6f69-9177-4a9b-8f7c-d8c0ec7c2ed2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.242245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1274/2587] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:15.247368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.257990 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad63b-9a14-487a-9388-004c360c10f3 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.264114 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.265001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.265328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.265611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] PATH_INFO: `/v3/projects/8efb2915f521487fa9543d636a8685ca/users/5ff9601ce5554a17bfe1a922be99c090/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.267717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efb2915f521487fa9543d636a8685ca, user_id=5ff9601ce5554a17bfe1a922be99c090, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.270541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.281704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1314/2588] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:15 2022] PUT /identity/v3/projects/8efb2915f521487fa9543d636a8685ca/users/5ff9601ce5554a17bfe1a922be99c090/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:15.291880 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.292169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.292447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.319565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] MFA Rules not processed for user `5ff9601ce5554a17bfe1a922be99c090`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:15.320866 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:15.334556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:15.393954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1275/2589] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:15 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:15.405530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.407323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:15.443737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:15.474789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2c8d-cca5-4590-9105-e0fa00620be6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.481394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.482063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.482348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.482624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.493075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.494570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.507823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1315/2590] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:15.586199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:15.596500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435900c0-46f1-4c60-9502-a85f593cd0a8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:15.600046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:15.600684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:15.600968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:15.601280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:15.659284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:15.660730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22dbb5-a61c-4c64-b88d-48773c91c3e6 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:15.670660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1276/2591] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:18.405626 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:18.470845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d08e2-674d-4f21-9e6a-75da90d22ea3 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:18.475474 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:18.476352 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:18.476636 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:18.476915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] PATH_INFO: `/v3/users/774423c160ab44468fa2b83e5586d8e8` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:18.478139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=774423c160ab44468fa2b83e5586d8e8)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:18.480058 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:18.530581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774423c160ab44468fa2b83e5586d8e8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:18.540845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774423c160ab44468fa2b83e5586d8e8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:18.555597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774423c160ab44468fa2b83e5586d8e8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:18.557160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774423c160ab44468fa2b83e5586d8e8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:18.572654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774423c160ab44468fa2b83e5586d8e8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:18.579507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1316/2592] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:18 2022] DELETE /identity/v3/users/774423c160ab44468fa2b83e5586d8e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:18.583934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:18.584784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:18.585272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:18.602779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:18.604275 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:18.686708 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1277/2593] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:18.696694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:18.698230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:18.758100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:18.763178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7c1c8-2d48-465c-91b1-830326bc1958 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:18.768197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:18.769335 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:18.769907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:18.770295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:18.782628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:18.784088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:18.795854 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1317/2594] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:19.075054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:19.076276 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:19.093409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406bdc1-16f1-491e-a26e-7b06701daa9b None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:19.099351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:19.101661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.101949 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.102250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] PATH_INFO: `/v3/projects/f34d5495e92d4a3984b19aec7eb8b1c4` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.103479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34d5495e92d4a3984b19aec7eb8b1c4)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:19.106391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:19.156621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:19.159763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34d5495e92d4a3984b19aec7eb8b1c4', 'request_id': 'req-8e7c65be-c76f-4b42-a589-603aff5f1165'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.166133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34d5495e92d4a3984b19aec7eb8b1c4', 'request_id': 'req-8e7c65be-c76f-4b42-a589-603aff5f1165'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.174966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34d5495e92d4a3984b19aec7eb8b1c4', 'request_id': 'req-8e7c65be-c76f-4b42-a589-603aff5f1165'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.186729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] The token cache is being invalidate because project f34d5495e92d4a3984b19aec7eb8b1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:19.187015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.187663 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.189435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1278/2595] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:19 2022] DELETE /identity/v3/projects/f34d5495e92d4a3984b19aec7eb8b1c4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:19.193165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:19.203808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f34261-52cc-4c05-b43d-03f2ba01b730 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:19.264907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:19.265858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.266138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.266394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] PATH_INFO: `/v3/users/5ff9601ce5554a17bfe1a922be99c090` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.267874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff9601ce5554a17bfe1a922be99c090)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:19.269906 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:19.315764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff9601ce5554a17bfe1a922be99c090'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.322576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff9601ce5554a17bfe1a922be99c090'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.330205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff9601ce5554a17bfe1a922be99c090'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.330860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff9601ce5554a17bfe1a922be99c090'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.344109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-b4890ab7-4cb8-4d02-a446-851914adbf08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff9601ce5554a17bfe1a922be99c090'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.350086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1318/2596] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:19 2022] DELETE /identity/v3/users/5ff9601ce5554a17bfe1a922be99c090 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:19.623223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:19.624705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:19.643536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c65be-c76f-4b42-a589-603aff5f1165 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:19.722333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:19.723202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.723478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.723749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] PATH_INFO: `/v3/projects/8efb2915f521487fa9543d636a8685ca` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.724927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efb2915f521487fa9543d636a8685ca)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:19.726891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:19.776224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efb2915f521487fa9543d636a8685ca', 'request_id': 'req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.782838 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efb2915f521487fa9543d636a8685ca', 'request_id': 'req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.790330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efb2915f521487fa9543d636a8685ca', 'request_id': 'req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.801903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] The token cache is being invalidate because project 8efb2915f521487fa9543d636a8685ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:19.802116 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.802781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-05b7bc08-5aa5-4aac-8acc-0fa9f7eb0e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:19.804336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1279/2597] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:19 2022] DELETE /identity/v3/projects/8efb2915f521487fa9543d636a8685ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:19.810265 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.811037 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.811237 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.830492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:19.831724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:19.911454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1319/2598] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:19.920365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.920642 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.920920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.939598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:19.940825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:19.949418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1280/2599] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:19.953666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:19.963455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4a3c4-88c4-4f03-ae11-7c79477224da None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:19.968744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:19.969450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:19.969720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:19.970028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:19.970756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:19.971063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:19.972679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:19.979505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:19.986590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1320/2600] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:19.991337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.000612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e44e0c-c49c-4d56-a04d-714d07b1c2de None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.005302 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.005980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.006257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.006529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.007216 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.009092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.036205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1281/2601] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:45:20.040342 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.050553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb45ad2-00c6-488f-9136-86e1ef8d5be1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.115459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.116147 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.116428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.116703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.117435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.119367 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.142475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1321/2602] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:20 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:45:20.146508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.157530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d53a16-27d6-4c7a-9fd6-82b7f26e73ad admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.163558 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.164365 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.164659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.164940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.165755 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.167415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.180488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1282/2603] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:20.185161 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.195297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3f6ef-4a12-4b1a-837c-853e2c0f5f53 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.200045 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.200703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.200987 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.201310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.202063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.203658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44825a7f-3d38-4bb8-ba80-67f3e4b82b15 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.217556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1322/2604] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:20.218820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.231110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616a120-a74b-489c-8ae9-7f66d0bbf1e1 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.235969 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.237523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.237805 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.238330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] PATH_INFO: `/v3/projects/faad9333998c4664ae198633a4ccca7f/users/b4cc0439bfe743ecad5c9ccc2dc49d59/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.254122 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faad9333998c4664ae198633a4ccca7f, user_id=b4cc0439bfe743ecad5c9ccc2dc49d59, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.258910 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.268531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:20.274263 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1283/2605] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:20 2022] PUT /identity/v3/projects/faad9333998c4664ae198633a4ccca7f/users/b4cc0439bfe743ecad5c9ccc2dc49d59/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:20.284904 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.285211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.285487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.312012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] MFA Rules not processed for user `b4cc0439bfe743ecad5c9ccc2dc49d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:20.313333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:20.389843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1323/2606] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:20.397354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.469979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8352bfe-5b79-41c4-a6fb-940eb4758218 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.474682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.475336 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.475621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.475897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.476578 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.478548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.503624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1284/2607] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:20 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:20.507599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.519175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a398c0b-895b-4e88-a8d8-f64f88c1f66f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.587240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.587541 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.587818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.588088 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.588817 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.591920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.602623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:20.617345 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1324/2608] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:20 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:20.618839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.629757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5927c-6793-42e3-bb55-4e66d1cc0397 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.635531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.636231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.637163 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.637900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.638373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.639989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.651399 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1285/2609] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:20.656106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.666164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fec407-4a37-4153-9077-9bb6df086a60 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.670780 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.671659 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.671942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.672217 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] PATH_INFO: `/v3/projects/5b76b10f36964d698fda74ef671316b4/users/cc37cdb486494f36a037f6a04dc4a01c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.686751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b76b10f36964d698fda74ef671316b4, user_id=cc37cdb486494f36a037f6a04dc4a01c, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.689415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.703030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1325/2610] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:20 2022] PUT /identity/v3/projects/5b76b10f36964d698fda74ef671316b4/users/cc37cdb486494f36a037f6a04dc4a01c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:20.707123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.718005 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f196de-d549-447b-8e48-770e9ecacb6d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.774143 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.774863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.775147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.775422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.776136 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.778411 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed6b8b-6886-42fd-b46e-19fbed81cc03 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.788243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1286/2611] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:20.792582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.803632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed9c1f-03ab-46ad-b329-bb06d4ef2574 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:20.808928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:20.809930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.810212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.810492 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] PATH_INFO: `/v3/projects/5b76b10f36964d698fda74ef671316b4/users/cc37cdb486494f36a037f6a04dc4a01c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.812481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b76b10f36964d698fda74ef671316b4, user_id=cc37cdb486494f36a037f6a04dc4a01c, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:20.815128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:20.825084 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1326/2612] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:20 2022] PUT /identity/v3/projects/5b76b10f36964d698fda74ef671316b4/users/cc37cdb486494f36a037f6a04dc4a01c/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:20.835936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:20.836231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:20.836540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:20.864132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] MFA Rules not processed for user `cc37cdb486494f36a037f6a04dc4a01c`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:20.865295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:20.928488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:20.939170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1287/2613] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:20.949746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:20.951525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:21.009515 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c98664-0b72-48f4-b31a-ac420422f85f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:21.013772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:21.014414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:21.014704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:21.014977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:21.069039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:21.070505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:21.080366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1327/2614] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:25.674241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:25.684375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7096d-2fa1-43bf-9fb7-01aabd920e0f None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:25.687941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:25.688661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:25.688870 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:25.689139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:25.698652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:25.700557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:25.710140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1288/2615] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:25.979196 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:25.981301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:26.048874 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85878fd-6621-47db-9fa0-ef11ab799ef8 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:26.052600 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:26.053289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:26.053569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:26.053887 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:26.055660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:26.084112 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:26.124240 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:26.125736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:26.135581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1328/2616] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:29.350682 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:29.352175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:29.367474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d315d-426e-4450-ad59-c78c57afc807 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:29.372811 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:29.373756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:29.374035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:29.374309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] PATH_INFO: `/v3/users/2768181f8a814902b8dcf50ce32907d0` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:29.375487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2768181f8a814902b8dcf50ce32907d0)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:29.377485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:29.426781 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2768181f8a814902b8dcf50ce32907d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:29.434569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2768181f8a814902b8dcf50ce32907d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:29.442406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2768181f8a814902b8dcf50ce32907d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:29.454640 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2768181f8a814902b8dcf50ce32907d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:29.455363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b0d79992-db65-4645-b17f-7fbca312ee91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2768181f8a814902b8dcf50ce32907d0'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:29.461922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1289/2617] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:29 2022] DELETE /identity/v3/users/2768181f8a814902b8dcf50ce32907d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:29.878315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:29.891576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b03b-3186-488a-8097-ba0a81cd98b1 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:29.949542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:29.950413 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:29.950694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:29.950965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] PATH_INFO: `/v3/projects/c9b5eb6ef5a942be9fcea8b26370a6fc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:29.952177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b5eb6ef5a942be9fcea8b26370a6fc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:29.954151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.001510 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'request_id': 'req-0398af8b-cbd0-44a5-a483-a73fd53269db'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:30.006952 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'request_id': 'req-0398af8b-cbd0-44a5-a483-a73fd53269db'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:30.013296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b5eb6ef5a942be9fcea8b26370a6fc', 'request_id': 'req-0398af8b-cbd0-44a5-a483-a73fd53269db'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:30.025386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] The token cache is being invalidate because project c9b5eb6ef5a942be9fcea8b26370a6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:30.025677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:30.026300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-0398af8b-cbd0-44a5-a483-a73fd53269db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:30.028421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1329/2618] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:29 2022] DELETE /identity/v3/projects/c9b5eb6ef5a942be9fcea8b26370a6fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:30.034291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.034659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.035013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.053575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:30.054801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:30.117178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1290/2619] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:30.125234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.125532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.125841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.144946 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:30.146202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:30.154863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1330/2620] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:30.158978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.169402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0ce9-ad38-4ec9-83d2-f1b9df9157c8 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.174072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.174724 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.175007 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.175287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.176014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:30.176321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.177971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.189614 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1291/2621] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:30.193728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.203202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f55a7-b117-491a-a4c2-e10a561e6b90 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.207796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.208449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.208709 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.208978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.209703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.211558 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.238467 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1331/2622] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:30.242631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.253573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74466496-c1fa-464a-91a0-79ca9975612e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.294414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:30.313074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.313768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.314054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.314331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.315011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.316992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.337543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1292/2623] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:30.342140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.352738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16a44e-0deb-4722-af2e-e5daf8dd59dc admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.358130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.358751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.359035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.359313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.360247 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.362685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.376193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1332/2624] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:30.379922 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.391338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c38f42-9e9c-4388-816e-73fd96dda065 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.396988 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.398027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.398027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.398469 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.399284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.400938 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055ba6-3a05-4c3e-86a7-70cd82f51dfb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.413414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1293/2625] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:30.417699 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.429439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559d57e-f2c1-46cb-b5d8-a74417f21a2e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.434277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.435173 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.435453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.435726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] PATH_INFO: `/v3/projects/f6909597fea64f9fb3afd01f4b7ffe2b/users/1a34eda177b14fa28166776b4db99e35/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.451528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:30.455907 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6909597fea64f9fb3afd01f4b7ffe2b, user_id=1a34eda177b14fa28166776b4db99e35, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.459082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.480200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1333/2626] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:30 2022] PUT /identity/v3/projects/f6909597fea64f9fb3afd01f4b7ffe2b/users/1a34eda177b14fa28166776b4db99e35/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:30.490454 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.490750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.491036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.519958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] MFA Rules not processed for user `1a34eda177b14fa28166776b4db99e35`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:30.521170 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:30.593549 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1294/2627] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:30.595035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.668568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1303f6-273e-41b5-b151-df1b18bf64cd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.673208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.673894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.674182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.674461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.675154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.677030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.701773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1334/2628] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:30.705801 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.717219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758916d-5dc0-4e32-9e5a-15be00d75cb0 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.772696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.773393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.773677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.773950 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.774645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.777112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.797524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1295/2629] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:30.801540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.812179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d4756-06cb-451c-ac5f-95cb89219b60 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.816746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.817457 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.817739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.818015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.818764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.820347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.830760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1335/2630] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:30.834488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.845050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddf4c0-16d2-403f-9b3a-b735c56b3c39 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.849694 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.850341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.850623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.850897 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.851629 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.853227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb79d6-a47f-4a10-909d-382257561ace admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.865803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1296/2631] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:30.869863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:30.879828 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ef6ef-bf3f-403f-9850-f4c76432f2ce admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:30.884389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:30.885310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.885594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.885924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] PATH_INFO: `/v3/projects/7cd15cb10d0f414db43fa9920ecf8505/users/da1c03d822b84da0a3fa4b1e6d1c1ddc/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.900917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd15cb10d0f414db43fa9920ecf8505, user_id=da1c03d822b84da0a3fa4b1e6d1c1ddc, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:30.904209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:30.918757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1336/2632] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:30 2022] PUT /identity/v3/projects/7cd15cb10d0f414db43fa9920ecf8505/users/da1c03d822b84da0a3fa4b1e6d1c1ddc/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:30.930068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:30.930358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:30.930635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:30.957080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] MFA Rules not processed for user `da1c03d822b84da0a3fa4b1e6d1c1ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:30.958307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:30.975018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:31.023648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1297/2633] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:31.028829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.091867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13732f6-4a09-45d0-af2a-4c914c5023ce admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.096569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.097263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.097547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.097940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.098502 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.100532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.127693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1337/2634] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:31 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:31.131860 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.143470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496c368-b021-44f6-8fe6-fb71433a00cc None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.200830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.201540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.201823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.202099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.202777 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.204720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.225273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1298/2635] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:31 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:31.229216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.239971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85737995-863e-4d37-bef8-e5ff1c08a52d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.244951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.246216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.246480 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.246755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.247477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.249052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.259597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1338/2636] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:31.264227 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.274255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a478d-ff3e-4aff-87c6-e376e0318879 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.279992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.280883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.281161 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.281468 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] PATH_INFO: `/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f/users/3c762df249b74c12b5bc90237b7dc39e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.296270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afb4a09c5274a5abb7f6a82c6a6f36f, user_id=3c762df249b74c12b5bc90237b7dc39e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.298929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.312014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1299/2637] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:31 2022] PUT /identity/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f/users/3c762df249b74c12b5bc90237b7dc39e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:31.315908 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.326842 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e75d9e-bcf7-448a-9be8-3e87506d5a75 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.335686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:31.384208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.384798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.385089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.385392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.386727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.388365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced39d36-e74b-49ab-842c-35d408ee5757 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.398264 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1339/2638] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:31.403089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.413391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478970a-04bb-4f13-be28-128431785df2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.418068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.418940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.419222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.419494 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] PATH_INFO: `/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f/users/3c762df249b74c12b5bc90237b7dc39e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.421508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afb4a09c5274a5abb7f6a82c6a6f36f, user_id=3c762df249b74c12b5bc90237b7dc39e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.424128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.434243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1300/2639] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:31 2022] PUT /identity/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f/users/3c762df249b74c12b5bc90237b7dc39e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:31.444532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.444825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.445104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.472164 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] MFA Rules not processed for user `3c762df249b74c12b5bc90237b7dc39e`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:31.473406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:31.539996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1340/2640] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:31.551123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:31.552847 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:31.608884 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222acff-3553-448c-81e4-a3c8a8ea9b07 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:31.612560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:31.613484 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:31.613764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:31.614035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:31.623359 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:31.624779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:31.634084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1301/2641] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:32.111514 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:32.113365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:32.125526 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ecef4-558b-43fe-9d8e-9f59c076b1e2 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:32.129168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:32.129865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:32.130179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:32.130455 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:32.187779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:32.189141 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:32.198160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1341/2642] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:39.350419 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:39.362962 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a043618-c721-484c-b464-eb375fe1f28d service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:39.366584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:39.367239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:39.367519 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:39.367796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:39.378953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:39.441303 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:39.442768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c1207-cffb-4ec9-8fc7-47a6cdfbaed4 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:39.454980 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1302/2643] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:41.524763 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:41.562430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=100 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:41.591419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd0a07-b5d1-48cd-acb0-000cdda9823a service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:41.595949 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:41.596812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:41.597095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:41.597473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] PATH_INFO: `/v3/users/1a34eda177b14fa28166776b4db99e35` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:41.598656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a34eda177b14fa28166776b4db99e35)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:41.600581 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:41.646434 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a34eda177b14fa28166776b4db99e35'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:41.654604 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a34eda177b14fa28166776b4db99e35'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:41.661729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a34eda177b14fa28166776b4db99e35'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:41.662362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a34eda177b14fa28166776b4db99e35'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:41.674276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a34eda177b14fa28166776b4db99e35'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:41.680792 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1342/2644] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:41 2022] DELETE /identity/v3/users/1a34eda177b14fa28166776b4db99e35 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:41.685158 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:41.685703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:41.685825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:41.704075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:41.705322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:41.764436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1303/2645] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:41.774252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:41.775652 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:41.833398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be841b71-35d1-425b-8653-c8f92f26769d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:41.836974 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:41.837663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:41.837945 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:41.838223 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:41.848126 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:41.849588 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:41.859524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1343/2646] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:42.129112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:42.130639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:42.143437 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111b60-32e8-48bf-a0c2-38844e2d598d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:42.148167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:42.149097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:42.149406 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:42.149678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] PATH_INFO: `/v3/projects/f6909597fea64f9fb3afd01f4b7ffe2b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:42.150859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6909597fea64f9fb3afd01f4b7ffe2b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:42.153327 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:42.199844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6909597fea64f9fb3afd01f4b7ffe2b', 'request_id': 'req-2e935161-ba91-443e-9633-1b8e50cf441e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.205370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6909597fea64f9fb3afd01f4b7ffe2b', 'request_id': 'req-2e935161-ba91-443e-9633-1b8e50cf441e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.212415 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6909597fea64f9fb3afd01f4b7ffe2b', 'request_id': 'req-2e935161-ba91-443e-9633-1b8e50cf441e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.223941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] The token cache is being invalidate because project f6909597fea64f9fb3afd01f4b7ffe2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:42.224224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.224841 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.226385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1304/2647] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:42 2022] DELETE /identity/v3/projects/f6909597fea64f9fb3afd01f4b7ffe2b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:42.231104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:42.240782 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc94657-5a48-4c1e-b7f0-d9b30966f4b5 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:42.292070 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:42.300215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:42.301399 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:42.301926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:42.302395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] PATH_INFO: `/v3/users/da1c03d822b84da0a3fa4b1e6d1c1ddc` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:42.303603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1c03d822b84da0a3fa4b1e6d1c1ddc)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:42.305594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:42.352693 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1c03d822b84da0a3fa4b1e6d1c1ddc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.360941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1c03d822b84da0a3fa4b1e6d1c1ddc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.367959 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1c03d822b84da0a3fa4b1e6d1c1ddc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.368576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1c03d822b84da0a3fa4b1e6d1c1ddc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.380529 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1c03d822b84da0a3fa4b1e6d1c1ddc'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.387321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1344/2648] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:42 2022] DELETE /identity/v3/users/da1c03d822b84da0a3fa4b1e6d1c1ddc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:42.660829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:42.662304 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:42.676607 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e935161-ba91-443e-9633-1b8e50cf441e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:42.711087 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:42.737742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:42.738635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:42.738917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:42.739193 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] PATH_INFO: `/v3/projects/7cd15cb10d0f414db43fa9920ecf8505` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:42.740370 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd15cb10d0f414db43fa9920ecf8505)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:42.742307 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:42.789861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd15cb10d0f414db43fa9920ecf8505', 'request_id': 'req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.796026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd15cb10d0f414db43fa9920ecf8505', 'request_id': 'req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.803572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd15cb10d0f414db43fa9920ecf8505', 'request_id': 'req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.815175 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] The token cache is being invalidate because project 7cd15cb10d0f414db43fa9920ecf8505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:42.815460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.816108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.817666 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1305/2649] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:42 2022] DELETE /identity/v3/projects/7cd15cb10d0f414db43fa9920ecf8505 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:42.821683 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:42.823176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:42.835616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e065388-9bfd-4dd5-804a-a00bf87b9c3e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:42.891943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:42.892853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:42.893175 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:42.893552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] PATH_INFO: `/v3/users/3c762df249b74c12b5bc90237b7dc39e` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:42.895023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c762df249b74c12b5bc90237b7dc39e)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:42.897009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:42.943208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c762df249b74c12b5bc90237b7dc39e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.950082 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c762df249b74c12b5bc90237b7dc39e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.956925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c762df249b74c12b5bc90237b7dc39e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.957563 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c762df249b74c12b5bc90237b7dc39e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.968491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:42.970980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9fe19868-dc16-4349-b86c-3237d58c5d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c762df249b74c12b5bc90237b7dc39e'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:42.978496 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1345/2650] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:42 2022] DELETE /identity/v3/users/3c762df249b74c12b5bc90237b7dc39e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:43.257671 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.259105 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:43.272737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a073c-47ce-49f0-b407-7c77d8ee8e36 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.331295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.332081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.332360 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.332637 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] PATH_INFO: `/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.333820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afb4a09c5274a5abb7f6a82c6a6f36f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.335703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.382323 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afb4a09c5274a5abb7f6a82c6a6f36f', 'request_id': 'req-48731387-cd17-4ea2-b12a-83e521b0f0b2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:43.388282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afb4a09c5274a5abb7f6a82c6a6f36f', 'request_id': 'req-48731387-cd17-4ea2-b12a-83e521b0f0b2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:43.395572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afb4a09c5274a5abb7f6a82c6a6f36f', 'request_id': 'req-48731387-cd17-4ea2-b12a-83e521b0f0b2'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:43.397545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:43.408742 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] The token cache is being invalidate because project 6afb4a09c5274a5abb7f6a82c6a6f36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:43.409149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:43.409930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-48731387-cd17-4ea2-b12a-83e521b0f0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:43.411459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1306/2651] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:43 2022] DELETE /identity/v3/projects/6afb4a09c5274a5abb7f6a82c6a6f36f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:43.418985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.419281 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.419552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.438242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:43.439479 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:43.499486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1346/2652] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:43.508670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.508960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.509286 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.527927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:43.529138 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:43.537156 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1307/2653] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:43.541272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.550942 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ffc6e-fc3a-4804-b2b1-9911f6213d22 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.555538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.556213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.556497 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.556802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.558059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:43.558364 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.559958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.571426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1347/2654] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:43.576401 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.585945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68748b-4d22-47bb-922b-ebe780cc9b96 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.591114 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.591756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.592036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.592309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.592991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.594907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.621108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1308/2655] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:43.625178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.635001 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1398777-5f46-4de0-9132-56cb408251c0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.692814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.693507 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.693789 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.694062 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.694750 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.696641 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.717466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1348/2656] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:43.721545 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.732649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8742bd-4bdd-4524-987b-e79520d3cbd6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.737214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.738159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.738441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.738719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.739446 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.741037 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.752054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1309/2657] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:43.755833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.766171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645186c-3520-4e82-9f91-52f3633a56d1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.770787 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.771441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.771725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.772002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.772723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.774361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df7462-cc00-4a93-b51a-f4eafdaf1c03 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.784867 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1349/2658] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:43.788970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.800542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227896-26c4-4055-9718-3bf8bd4fcbd7 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:43.805254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:43.806126 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.806408 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.806738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] PATH_INFO: `/v3/projects/6027a1a4f31e43feb53ac54b39d917b6/users/957a8212c97d4e529d344a16ac50d48d/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.822141 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6027a1a4f31e43feb53ac54b39d917b6, user_id=957a8212c97d4e529d344a16ac50d48d, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:43.824946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:43.838195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1310/2659] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:43 2022] PUT /identity/v3/projects/6027a1a4f31e43feb53ac54b39d917b6/users/957a8212c97d4e529d344a16ac50d48d/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:43.850182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:43.850674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:43.850796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:43.878431 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] MFA Rules not processed for user `957a8212c97d4e529d344a16ac50d48d`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:43.879707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:43.927242 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:43.946392 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1350/2660] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:43.957951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:43.959658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:44.016785 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2860af-2c1f-46b0-b3f8-ee8c15aa8a34 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:44.020438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:44.021078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:44.021388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:44.021672 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:44.030713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:44.032427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362fba9-dc6d-44e8-8055-3d37e136e438 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:44.046409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1311/2661] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:50.593700 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:50.595136 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:50.663453 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5333d-3c4e-4d5b-a0d7-ec917005fe8c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:50.669130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:50.670038 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:50.670320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:50.670595 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] PATH_INFO: `/v3/users/b4cc0439bfe743ecad5c9ccc2dc49d59` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:50.671798 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cc0439bfe743ecad5c9ccc2dc49d59)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:50.673786 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:50.723348 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cc0439bfe743ecad5c9ccc2dc49d59'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:50.731538 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cc0439bfe743ecad5c9ccc2dc49d59'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:50.740151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cc0439bfe743ecad5c9ccc2dc49d59'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:50.740849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cc0439bfe743ecad5c9ccc2dc49d59'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:50.760676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cc0439bfe743ecad5c9ccc2dc49d59'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:50.766753 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1351/2662] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:50 2022] DELETE /identity/v3/users/b4cc0439bfe743ecad5c9ccc2dc49d59 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:50.771321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:50.771851 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:50.771961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:50.788621 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:50.789874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:50.853726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1312/2663] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:50.863585 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:50.865108 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:50.923340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1203cd7-6d0e-4c45-9cb4-557a64c4ff72 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:50.926956 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:50.927714 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:50.927996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:50.928485 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:50.937559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:50.939096 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:50.949297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1352/2664] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:51.366556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:51.368113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:51.378222 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:51.381106 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:51.408231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb98b7-275a-4ac6-a53e-8c9d5efdda4c service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:51.410046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef360f7-5d9a-402f-b7aa-c339add1b986 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:51.413505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:51.414386 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:51.414673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:51.414939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] PATH_INFO: `/v3/users/957a8212c97d4e529d344a16ac50d48d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:51.416118 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=957a8212c97d4e529d344a16ac50d48d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:51.418599 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:51.419441 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:51.421348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:51.421645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:51.422546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] PATH_INFO: `/v3/projects/faad9333998c4664ae198633a4ccca7f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:51.423565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faad9333998c4664ae198633a4ccca7f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:51.425528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:51.425885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:51.471066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:51.481676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957a8212c97d4e529d344a16ac50d48d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.489350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faad9333998c4664ae198633a4ccca7f', 'request_id': 'req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.491183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957a8212c97d4e529d344a16ac50d48d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.496588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faad9333998c4664ae198633a4ccca7f', 'request_id': 'req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.499120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957a8212c97d4e529d344a16ac50d48d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.499802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957a8212c97d4e529d344a16ac50d48d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.505039 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faad9333998c4664ae198633a4ccca7f', 'request_id': 'req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.514409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-839eee93-0412-4a5a-b223-0385c3bf8a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957a8212c97d4e529d344a16ac50d48d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.518404 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] The token cache is being invalidate because project faad9333998c4664ae198633a4ccca7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:51.518802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.519667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.521331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1313/2665] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:51 2022] DELETE /identity/v3/projects/faad9333998c4664ae198633a4ccca7f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:51.524441 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1353/2666] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:51 2022] DELETE /identity/v3/users/957a8212c97d4e529d344a16ac50d48d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:51.526373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:51.527926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:51.529929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:51.530452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:51.530452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:51.548040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:51.549289 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:51.607720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1353a65-3cbb-4cfd-b840-f5fcb1b84b5a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:51.625760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1354/2667] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:51.634977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:51.637439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:51.683240 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:51.684279 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:51.684608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:51.685050 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] PATH_INFO: `/v3/users/cc37cdb486494f36a037f6a04dc4a01c` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:51.686481 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc37cdb486494f36a037f6a04dc4a01c)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:51.688803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:51.712655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b933d-f45b-4d09-93ff-cf9a7ca438f6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:51.717094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:51.717837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:51.718182 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:51.718519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:51.729656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:51.731491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:51.745275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1355/2668] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:45:51.755784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc37cdb486494f36a037f6a04dc4a01c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.768605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc37cdb486494f36a037f6a04dc4a01c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.779425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc37cdb486494f36a037f6a04dc4a01c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.787425 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:51.800160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc37cdb486494f36a037f6a04dc4a01c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.802162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc37cdb486494f36a037f6a04dc4a01c'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:51.812182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1314/2669] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:51 2022] DELETE /identity/v3/users/cc37cdb486494f36a037f6a04dc4a01c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:52.241245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.242773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.267712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e985e38-5989-4f6e-a437-24b6481a42d7 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.304247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.305712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:52.306486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.362720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.363856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.364218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.364590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] PATH_INFO: `/v3/projects/6027a1a4f31e43feb53ac54b39d917b6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.366470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6027a1a4f31e43feb53ac54b39d917b6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.368559 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.393590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81abbf-1f55-4a4d-b76f-bef27c25961f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.398354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.399232 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.399509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.399790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] PATH_INFO: `/v3/projects/5b76b10f36964d698fda74ef671316b4` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.401600 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b76b10f36964d698fda74ef671316b4)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.403540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.440066 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6027a1a4f31e43feb53ac54b39d917b6', 'request_id': 'req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.447300 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6027a1a4f31e43feb53ac54b39d917b6', 'request_id': 'req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.456304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6027a1a4f31e43feb53ac54b39d917b6', 'request_id': 'req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.468923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b76b10f36964d698fda74ef671316b4', 'request_id': 'req-0012b3d2-1687-466c-a8f3-27a2e07c92d6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.473553 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] The token cache is being invalidate because project 6027a1a4f31e43feb53ac54b39d917b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:52.473950 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.474860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dfff8e06-b4c7-407c-a0e4-a99d161aa78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.475290 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b76b10f36964d698fda74ef671316b4', 'request_id': 'req-0012b3d2-1687-466c-a8f3-27a2e07c92d6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.476577 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1356/2670] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:52 2022] DELETE /identity/v3/projects/6027a1a4f31e43feb53ac54b39d917b6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:52.481305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ede-97d3-491b-8ac3-8aa544d21fa1 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.481685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ede-97d3-491b-8ac3-8aa544d21fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.482035 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9ede-97d3-491b-8ac3-8aa544d21fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.490030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b76b10f36964d698fda74ef671316b4', 'request_id': 'req-0012b3d2-1687-466c-a8f3-27a2e07c92d6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.504418 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-ba7f9ede-97d3-491b-8ac3-8aa544d21fa1 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:52.505393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] The token cache is being invalidate because project 5b76b10f36964d698fda74ef671316b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:52.505764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.506625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ba7f9ede-97d3-491b-8ac3-8aa544d21fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.506756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-0012b3d2-1687-466c-a8f3-27a2e07c92d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:52.508821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1315/2671] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:52 2022] DELETE /identity/v3/projects/5b76b10f36964d698fda74ef671316b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:52.514523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a455b-316f-47b6-99e4-5da25eac67e5 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.515472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a455b-316f-47b6-99e4-5da25eac67e5 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.515852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a455b-316f-47b6-99e4-5da25eac67e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.539918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-361a455b-316f-47b6-99e4-5da25eac67e5 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:52.542067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-361a455b-316f-47b6-99e4-5da25eac67e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.587679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1357/2672] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:52.595858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.597584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.598146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.617078 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1316/2673] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:52.621735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:52.623327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.625575 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.626834 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.627133 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.640060 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1358/2674] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:52.644934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.656508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67b80-e4da-494d-b38d-674c80554dd5 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.656797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:52.659541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:52.661833 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.662245 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.662525 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.662805 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.663533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:52.663894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.665540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.681009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1359/2675] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:52.685732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.688868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1317/2676] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:52.689927 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.698483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e337-51b3-4bb2-a7e9-e8ca1ea636e1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.699930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813b9fb-7a5e-4664-83f2-31354473cf8c None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.703498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.704231 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.704584 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.704926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.705757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.705958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.706685 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.707035 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.707393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.708009 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.708245 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:52.708619 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.710726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.715177 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:52.731439 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1318/2677] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:52.732482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.741741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1360/2678] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:52.743086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b3aee-8f52-498e-8453-adeda02e9e78 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.747528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.773053 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:52.814963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.815730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.816113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.816452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.817236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.819212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.825337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c3717-90ed-4813-a414-90a4f2779f08 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.830924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.831663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.832063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.832339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.833046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.834999 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.853250 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1319/2679] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:52.856081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.865398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1361/2680] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:52.866287 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.877878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1d49f-f06f-46aa-ace7-b625ee10b519 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.931589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62fbfc-edd5-4492-b56a-8ab9676d44ea admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.936878 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.937604 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.937890 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.938423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.939173 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.941201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.944941 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.945640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.945922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.946194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.946912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.949766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.961203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1362/2681] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:52.965726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.969923 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1320/2682] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:52 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:45:52.974208 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:52.977669 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735447c4-7cfb-476b-9d14-48ab4c5d8126 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.984221 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.984980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.985295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.985830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.986575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.987470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fadf3-4c16-4d4d-ab9d-f36456032d88 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:52.988454 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:52.998824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:52.998824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:52.998824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:52.998824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:52.999916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:52.999916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.005361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1363/2683] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:53.008177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.015384 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1321/2684] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:53.019015 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.020622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f9d6d-ac0e-4e73-8bac-702884760ab9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.027054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.027963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.028252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.028530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] PATH_INFO: `/v3/projects/3c886fb492cd4514a0bec0539875831e/users/6210ff430cd14131a89521868685293b/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.039356 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c225-3f1a-40d3-8b2f-f40891525115 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.045131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.045835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.046110 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.046392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.047118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.048926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.050564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c886fb492cd4514a0bec0539875831e, user_id=6210ff430cd14131a89521868685293b, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.053323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6406fb-6630-4bd9-bbdd-038e3e18ea19 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.062947 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1322/2685] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:53.067569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.078917 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83ee2-b6ca-416e-a549-50610e689d64 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.081667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1364/2686] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:53 2022] PUT /identity/v3/projects/3c886fb492cd4514a0bec0539875831e/users/6210ff430cd14131a89521868685293b/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:53.087310 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.088008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.090487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.123431 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] MFA Rules not processed for user `6210ff430cd14131a89521868685293b`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:53.124746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:53.132792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:53.150507 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.152598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.153066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.153763 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] PATH_INFO: `/v3/projects/d76e1bebc4264544af6d6cb27fe25522/users/732b6dd737cf4138be680940cb2acde8/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.175016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76e1bebc4264544af6d6cb27fe25522, user_id=732b6dd737cf4138be680940cb2acde8, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.178233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc5f0d-7f03-4e21-82c7-6778e1b2b6f0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.197069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1323/2687] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:53 2022] PUT /identity/v3/projects/d76e1bebc4264544af6d6cb27fe25522/users/732b6dd737cf4138be680940cb2acde8/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:53.210330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:53.211313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.211529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.212055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.222208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1365/2688] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:53.234338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.235983 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:53.270165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] MFA Rules not processed for user `732b6dd737cf4138be680940cb2acde8`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:53.271515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:53.317388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282cee9-4cea-4d6d-9e2c-d45e8d554ffa None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.362713 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1324/2689] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:53.365740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.389220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.390190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.390674 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.391121 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.443987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b4bfe-d8f9-40f3-87d2-c71cebc0de5d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.450047 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.450946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.451236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.451495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.452182 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.454391 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.459079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.460609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.473745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1366/2690] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:45:53.486566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1325/2691] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:53 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:53.490827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.502774 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a2496-d825-427d-b51c-afa7b25e524f service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.566762 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.567452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.567738 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.568014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.568725 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.570736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.586039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:53.600788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1367/2692] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:53 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:53.604718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.619919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b618e0-9c67-477d-a933-5fcdccca131a admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.625137 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.625919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.626211 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.626569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.627433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.629246 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.644643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1326/2693] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:53.645912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.657580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a375914-c73c-4f4a-bc7a-75d0f660af6d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.666195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.667276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.667580 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.667861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] PATH_INFO: `/v3/projects/f89304ce37e14526b0f06538aeb3bf2f/users/8f9aee43173f48c091a67eaa3a9db495/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.684311 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89304ce37e14526b0f06538aeb3bf2f, user_id=8f9aee43173f48c091a67eaa3a9db495, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.687026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.701781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1368/2694] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:53 2022] PUT /identity/v3/projects/f89304ce37e14526b0f06538aeb3bf2f/users/8f9aee43173f48c091a67eaa3a9db495/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:53.708102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.723803 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215748c-f662-4fb5-b1eb-845cafaf085c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.786377 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:53.842338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.843017 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.843305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.843579 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.844472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.846099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d30cc-45c5-41a8-a3fa-0d865f48b9b2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.857435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1327/2695] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:53.861868 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:53.874314 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf72-b4e6-4286-9041-67d53517d46d admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:53.883766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:53.884838 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.885922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.886490 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] PATH_INFO: `/v3/projects/f89304ce37e14526b0f06538aeb3bf2f/users/8f9aee43173f48c091a67eaa3a9db495/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.888471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89304ce37e14526b0f06538aeb3bf2f, user_id=8f9aee43173f48c091a67eaa3a9db495, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:53.891355 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:53.905107 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1369/2696] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:53 2022] PUT /identity/v3/projects/f89304ce37e14526b0f06538aeb3bf2f/users/8f9aee43173f48c091a67eaa3a9db495/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:53.970503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:53.970794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:53.971060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:53.999241 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] MFA Rules not processed for user `8f9aee43173f48c091a67eaa3a9db495`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:54.000444 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:54.068383 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1328/2697] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:54.081004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.137654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85552e3-8987-4d20-9e67-8b1facd0f415 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:54.141329 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:54.141969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.142341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.142615 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.151617 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:54.153130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:54.162743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1370/2698] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:45:54.470830 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.481319 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc967ea3-505a-4d58-94a2-d8e8786d0862 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:54.486159 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9aee43173f48c091a67eaa3a9db495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f89304ce37e14526b0f06538aeb3bf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:54.486819 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.487358 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.487639 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.488366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:54.488690 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:54.490322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:54.502859 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1329/2699] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:54.506895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.516159 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91aebb-6c8a-4bc7-b680-49b615b68cc7 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:54.520703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9aee43173f48c091a67eaa3a9db495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f89304ce37e14526b0f06538aeb3bf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:54.521380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.521670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.521948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.522643 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:54.524546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:54.550362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1371/2700] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:54 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:54.554551 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.565113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871294f2-9233-4909-a6e2-5b5c5cc5d33a tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:54.621752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9aee43173f48c091a67eaa3a9db495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f89304ce37e14526b0f06538aeb3bf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:54.622414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.622707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.622989 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.623709 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:54.624018 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:54.625650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975378e-5847-46f5-afb5-31314c11c20f tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:54.637695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1330/2701] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:45:54.673291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.684007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ca488-889e-4c3f-8439-9596c0adead4 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:54.688505 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9aee43173f48c091a67eaa3a9db495', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f89304ce37e14526b0f06538aeb3bf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:54.689401 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.689686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.689957 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] PATH_INFO: `/v3/projects/fbe4b31819a44a8c95267a7857dd1b94` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.691132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fbe4b31819a44a8c95267a7857dd1b94)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:54.693047 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:54.740993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe4b31819a44a8c95267a7857dd1b94', 'request_id': 'req-ddca19ee-4da8-48c8-966f-323b87dfe3e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:54.747194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe4b31819a44a8c95267a7857dd1b94', 'request_id': 'req-ddca19ee-4da8-48c8-966f-323b87dfe3e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:54.753350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe4b31819a44a8c95267a7857dd1b94', 'request_id': 'req-ddca19ee-4da8-48c8-966f-323b87dfe3e7'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:54.766211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] The token cache is being invalidate because project fbe4b31819a44a8c95267a7857dd1b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:54.766499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:54.767134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:54.768689 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1372/2702] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:54 2022] DELETE /identity/v3/projects/fbe4b31819a44a8c95267a7857dd1b94 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:54.894405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f49b6e-5d16-4c6e-92ed-e4d1f0f9f06f None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:54.894906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f49b6e-5d16-4c6e-92ed-e4d1f0f9f06f None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:54.895003 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f49b6e-5d16-4c6e-92ed-e4d1f0f9f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:54.914526 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e2f49b6e-5d16-4c6e-92ed-e4d1f0f9f06f None None] MFA Rules not processed for user `6210ff430cd14131a89521868685293b`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:54.915754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e2f49b6e-5d16-4c6e-92ed-e4d1f0f9f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:54.965764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:54.967040 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:54.970223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:55.005910 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:55.008546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1331/2703] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:55.059309 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca19ee-4da8-48c8-966f-323b87dfe3e7 tempest-VolumeQuotaClassesTest-56455438 tempest-VolumeQuotaClassesTest-56455438-project-admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:55.064686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:55.066014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:55.066014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:55.066178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] PATH_INFO: `/v3/users/732b6dd737cf4138be680940cb2acde8` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:55.067358 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732b6dd737cf4138be680940cb2acde8)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:55.069412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:55.134819 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732b6dd737cf4138be680940cb2acde8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.144032 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732b6dd737cf4138be680940cb2acde8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.153156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732b6dd737cf4138be680940cb2acde8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.154109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732b6dd737cf4138be680940cb2acde8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.175011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732b6dd737cf4138be680940cb2acde8'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.181528 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1373/2704] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:54 2022] DELETE /identity/v3/users/732b6dd737cf4138be680940cb2acde8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:55.187148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:55.187514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:55.187861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:55.205475 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:55.206779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:55.274084 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1332/2705] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:55.284099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:55.285800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:55.351992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00cb380-79b2-45eb-99d8-70f6277d9a74 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:55.356923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:55.357642 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:55.357925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:55.358201 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:55.368988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:55.371272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:55.381437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1374/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:55.695420 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:55.696977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:55.712568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021521c1-a6c7-4e7d-8c88-cfeba90dce82 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:55.719316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:55.720198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:55.720479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:55.720758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] PATH_INFO: `/v3/projects/d76e1bebc4264544af6d6cb27fe25522` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:55.722083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76e1bebc4264544af6d6cb27fe25522)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:55.723993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:55.779335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76e1bebc4264544af6d6cb27fe25522', 'request_id': 'req-47f10e24-8a9a-4663-87ce-4fb39af4c144'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.785160 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76e1bebc4264544af6d6cb27fe25522', 'request_id': 'req-47f10e24-8a9a-4663-87ce-4fb39af4c144'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.794751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76e1bebc4264544af6d6cb27fe25522', 'request_id': 'req-47f10e24-8a9a-4663-87ce-4fb39af4c144'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.806459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] The token cache is being invalidate because project d76e1bebc4264544af6d6cb27fe25522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:55.806754 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.807427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.808979 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1333/2707] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:55 2022] DELETE /identity/v3/projects/d76e1bebc4264544af6d6cb27fe25522 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:55.812938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:55.823144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01937aba-931d-4231-b128-f5139819cd28 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:55.870934 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:55.888274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:55.889155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:55.889465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:55.889751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] PATH_INFO: `/v3/users/8f9aee43173f48c091a67eaa3a9db495` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:55.891020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9aee43173f48c091a67eaa3a9db495)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:55.892940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:55.943645 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9aee43173f48c091a67eaa3a9db495'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.951964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9aee43173f48c091a67eaa3a9db495'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.959560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9aee43173f48c091a67eaa3a9db495'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.960292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9aee43173f48c091a67eaa3a9db495'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.973614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9aee43173f48c091a67eaa3a9db495'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:55.980797 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1375/2708] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:45:55 2022] DELETE /identity/v3/users/8f9aee43173f48c091a67eaa3a9db495 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:56.276300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.277002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.277977 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:56.278491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:56.291797 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10e24-8a9a-4663-87ce-4fb39af4c144 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.348361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8e7d-eb15-46aa-b359-cbd6f428acf6 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.352280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.352939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.353315 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.353516 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.353697 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.354624 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.354906 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.355178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] PATH_INFO: `/v3/projects/f89304ce37e14526b0f06538aeb3bf2f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.355989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:56.356355 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89304ce37e14526b0f06538aeb3bf2f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.358288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.368655 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:56.368920 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.371257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbe1f6-b84a-4494-b6e4-691a2f232373 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.382363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1376/2709] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:56.423879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89304ce37e14526b0f06538aeb3bf2f', 'request_id': 'req-f964f864-82af-4460-ae5e-09d965cdd19d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:56.430861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89304ce37e14526b0f06538aeb3bf2f', 'request_id': 'req-f964f864-82af-4460-ae5e-09d965cdd19d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:56.440282 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89304ce37e14526b0f06538aeb3bf2f', 'request_id': 'req-f964f864-82af-4460-ae5e-09d965cdd19d'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:56.454958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] The token cache is being invalidate because project f89304ce37e14526b0f06538aeb3bf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:45:56.455350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:56.456107 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f964f864-82af-4460-ae5e-09d965cdd19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:45:56.457933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1334/2710] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:45:56 2022] DELETE /identity/v3/projects/f89304ce37e14526b0f06538aeb3bf2f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:56.462640 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.462930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.464551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.484205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:56.485475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:56.569408 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1377/2711] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:56.577086 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.578044 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.578395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.607164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:56.608616 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:56.623061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1335/2712] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:56.624357 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.637986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a34938-2099-42f0-9e2b-79e159041218 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.643022 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.643692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.643978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.644255 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.644986 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:45:56.645320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.646915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.649052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:56.673269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.677368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1378/2713] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:45:56.684027 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab708-b4bb-4897-8164-5a29433ff013 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.688743 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.689436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.689719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.689994 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.690693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.692598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.722698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1336/2714] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:56 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:56.724083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.736059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecfc76-28b1-4c95-b278-4953ca9fcd57 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.797851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.798634 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.799424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.799775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.800549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.802727 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.829469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1379/2715] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:56 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:56.830727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.841505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d6837-a7d6-4e09-b55a-2966356d6c44 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.846265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.846941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.847219 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.847495 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.848222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.849885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.865552 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1337/2716] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:45:56.866612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.878487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88bd82-db91-4e7a-b58d-141deca943e7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.883631 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.884317 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.884602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.885437 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.886178 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.887841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4564f-37da-45e1-bd70-652410b64670 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.900374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1380/2717] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:56.905300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:56.915622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec241-d890-4add-a883-ba29ea50f297 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:56.920605 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:56.921535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.921821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.922247 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] PATH_INFO: `/v3/projects/ae4709297c3f415bb27bf4b543621f38/users/255969ebc0bf4c9db5ed919750124f74/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.937572 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4709297c3f415bb27bf4b543621f38, user_id=255969ebc0bf4c9db5ed919750124f74, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:56.940273 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:56.954591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1338/2718] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:56 2022] PUT /identity/v3/projects/ae4709297c3f415bb27bf4b543621f38/users/255969ebc0bf4c9db5ed919750124f74/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:56.965808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:56.966270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:56.966602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:56.997856 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] MFA Rules not processed for user `255969ebc0bf4c9db5ed919750124f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:56.999213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:57.064351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1381/2719] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:45:57.069656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.140472 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f10a-8c9b-4c32-bfbc-5e524c84b946 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.145135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.145828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.146113 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.146389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.147094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.149006 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.179056 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1339/2720] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:45:57 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:57.180890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.194193 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a933cb-4bc3-4b39-9f8a-6ac959c4197c None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.252435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.253093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.253407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.253685 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.254374 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.256298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.263903 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:57.280458 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1382/2721] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:45:57 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:45:57.284081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.295295 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389de1-4a61-4178-8c53-d900bd26b6b8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.300045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.300716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.300991 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.301308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.302067 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.303668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.315656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1340/2722] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:57.319089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.329823 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bd80b-fa50-492e-bbc2-a0d5c1b545a7 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.335283 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.336183 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.336471 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.336749 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] PATH_INFO: `/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3/users/31e203feda5b41fcb7875404da73a7e3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.355557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6227b79fb3f74d89ae0639b4924ae8f3, user_id=31e203feda5b41fcb7875404da73a7e3, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.358279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.371741 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1383/2723] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:57 2022] PUT /identity/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3/users/31e203feda5b41fcb7875404da73a7e3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:45:57.375967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.387048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02ebfd-2452-4633-b5ae-698a21eea88c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.391054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:45:57.458261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.458939 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.459222 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.459497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.460220 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.461855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d99ef-4b4a-4a82-b11a-dbc318eb76f6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.472718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1341/2724] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:45:57.477462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.489361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703daeb5-d465-4b9b-b0df-aa4cacf65399 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.495726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.496712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.496996 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.497351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] PATH_INFO: `/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3/users/31e203feda5b41fcb7875404da73a7e3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.499376 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6227b79fb3f74d89ae0639b4924ae8f3, user_id=31e203feda5b41fcb7875404da73a7e3, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.502077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.513243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1384/2725] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:45:57 2022] PUT /identity/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3/users/31e203feda5b41fcb7875404da73a7e3/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:45:57.524313 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.524716 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.525069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.555974 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] MFA Rules not processed for user `31e203feda5b41fcb7875404da73a7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:45:57.558052 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:57.632237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1342/2726] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:45:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:45:57.643305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.644938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:45:57.704123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78dd9f-afbf-49ec-8f8c-8eed44fe72b0 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.707917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.708575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.708931 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.709307 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.719737 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.721414 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.731498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1385/2727] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:45:57.831983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:45:57.842376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b5cb9-a965-416d-b180-bc4767f55732 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:45:57.846036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:45:57.846733 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:45:57.847020 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:45:57.847296 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:45:57.906865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:45:57.908431 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1085e-9855-4ed8-a523-59a4cf8a436d service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:45:57.918095 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1343/2728] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:45:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:00.792415 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:00.886710 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b00d93-5ca1-4269-90ae-34eda012a1d1 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:00.892054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:00.893301 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:00.893764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:00.894204 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] PATH_INFO: `/v3/users/255969ebc0bf4c9db5ed919750124f74` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:00.895810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=255969ebc0bf4c9db5ed919750124f74)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:00.898398 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:00.977857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255969ebc0bf4c9db5ed919750124f74'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:00.997488 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255969ebc0bf4c9db5ed919750124f74'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.004291 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:01.028014 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255969ebc0bf4c9db5ed919750124f74'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.031239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255969ebc0bf4c9db5ed919750124f74'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.049984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255969ebc0bf4c9db5ed919750124f74'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.059211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1386/2729] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:00 2022] DELETE /identity/v3/users/255969ebc0bf4c9db5ed919750124f74 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:01.063473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.063960 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.064045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.093970 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:01.095322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.141086 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.143546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.148829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:01.227737 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1344/2730] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:01.238633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.240256 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.252210 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4695e9-a1a1-4012-8c93-0bb099e0fd29 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.257456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.258379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.258625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.258902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] PATH_INFO: `/v3/users/51def40a3de745a99f67c6ef2d2bcbf6` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.261297 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51def40a3de745a99f67c6ef2d2bcbf6)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.263560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:01.322824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c34c-ae9c-4657-8394-d6e8a227ba3d None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.328700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.329760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.330205 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.330590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.344934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.346712 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:01.350745 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51def40a3de745a99f67c6ef2d2bcbf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.360199 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1345/2731] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:46:01.363120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51def40a3de745a99f67c6ef2d2bcbf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.372916 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51def40a3de745a99f67c6ef2d2bcbf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.373733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51def40a3de745a99f67c6ef2d2bcbf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.388718 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51def40a3de745a99f67c6ef2d2bcbf6'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.395582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1387/2732] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:01 2022] DELETE /identity/v3/users/51def40a3de745a99f67c6ef2d2bcbf6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:01.673031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.684608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3deda-9179-4aa3-9511-fe08936d7ae8 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.751194 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.752669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.752958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.753550 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] PATH_INFO: `/v3/projects/9612b265be6144809add4ce9e14ff6ee` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.753666 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.754493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9612b265be6144809add4ce9e14ff6ee)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.755061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.756482 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:01.772313 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65d720-1e76-411e-9ff5-5a480c97b63f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.777475 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.778326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.778612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.778889 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] PATH_INFO: `/v3/projects/ae4709297c3f415bb27bf4b543621f38` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.780150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4709297c3f415bb27bf4b543621f38)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.782176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:01.809394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9612b265be6144809add4ce9e14ff6ee', 'request_id': 'req-83c7fc3a-e301-4f0f-b842-6f3e260864a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.816718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9612b265be6144809add4ce9e14ff6ee', 'request_id': 'req-83c7fc3a-e301-4f0f-b842-6f3e260864a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.825626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9612b265be6144809add4ce9e14ff6ee', 'request_id': 'req-83c7fc3a-e301-4f0f-b842-6f3e260864a6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.833478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4709297c3f415bb27bf4b543621f38', 'request_id': 'req-3be68ab2-5445-4419-861a-f9d5a593d709'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.833985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:01.834679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:01.838912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] The token cache is being invalidate because project 9612b265be6144809add4ce9e14ff6ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:01.839426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.840493 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-83c7fc3a-e301-4f0f-b842-6f3e260864a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.841402 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4709297c3f415bb27bf4b543621f38', 'request_id': 'req-3be68ab2-5445-4419-861a-f9d5a593d709'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.842426 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1346/2733] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:01 2022] DELETE /identity/v3/projects/9612b265be6144809add4ce9e14ff6ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:01.847646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1c34-6aad-4578-aa40-f6a776118f8b None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.847940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1c34-6aad-4578-aa40-f6a776118f8b None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.848223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d1c34-6aad-4578-aa40-f6a776118f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.849911 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4709297c3f415bb27bf4b543621f38', 'request_id': 'req-3be68ab2-5445-4419-861a-f9d5a593d709'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.864377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] The token cache is being invalidate because project ae4709297c3f415bb27bf4b543621f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:01.864757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.865512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:01.867540 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1388/2734] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:01 2022] DELETE /identity/v3/projects/ae4709297c3f415bb27bf4b543621f38 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:46:01.868714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-741d1c34-6aad-4578-aa40-f6a776118f8b None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:01.870531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-741d1c34-6aad-4578-aa40-f6a776118f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.871560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.872829 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.934065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1347/2735] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:46:01.941720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.942011 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.942344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.944977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68ab2-5445-4419-861a-f9d5a593d709 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.951926 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.952809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.953095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.953405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] PATH_INFO: `/v3/users/31e203feda5b41fcb7875404da73a7e3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.954628 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e203feda5b41fcb7875404da73a7e3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.957012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:01.960959 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:01.962233 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:01.971343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1348/2736] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:46:01.975398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:01.985567 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484df7-a710-4ab3-8861-7beec591a8bb None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:01.991183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:01.992032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:01.992344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:01.992626 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:01.993379 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:46:01.993688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:01.995510 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.007881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1349/2737] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:46:02.008054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e203feda5b41fcb7875404da73a7e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.012853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.016132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e203feda5b41fcb7875404da73a7e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.023030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe982d47-2811-458f-ae30-ffa1eef0976e admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.023784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e203feda5b41fcb7875404da73a7e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.024430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e203feda5b41fcb7875404da73a7e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.028239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.028882 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.029167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.029470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.030188 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.032081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.038015 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e203feda5b41fcb7875404da73a7e3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.044102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1389/2738] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:01 2022] DELETE /identity/v3/users/31e203feda5b41fcb7875404da73a7e3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:46:02.062537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1350/2739] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:02.063766 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.065232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:02.141705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:02.150918 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb567832-939b-46cd-a538-3894f124c065 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.222078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.222746 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.223029 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.223110 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.223944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.226119 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.247326 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1390/2740] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:02.251179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.262560 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e189-6968-43a7-a0ca-61274eb2bc3d admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.267292 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.267973 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.268373 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.268523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.269341 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.270942 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.285485 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1351/2741] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:46:02.286719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.297360 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc24b7-eded-42a4-9c3a-137d6263cc84 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.302132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.302802 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.303089 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.303369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.304095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.305784 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e332-161e-4a4e-a3aa-62b13c7ee131 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.316761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1391/2742] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:02.320999 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.332346 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c2ef5-e37b-485f-b55d-6a95d12293be admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.337656 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.338965 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.339328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.339681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] PATH_INFO: `/v3/projects/7bfcd7bc516549319872e88ee2fa7958/users/577b518bf55847f191fb5260bca21ba7/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.356924 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bfcd7bc516549319872e88ee2fa7958, user_id=577b518bf55847f191fb5260bca21ba7, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.359948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.374591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1352/2743] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:02 2022] PUT /identity/v3/projects/7bfcd7bc516549319872e88ee2fa7958/users/577b518bf55847f191fb5260bca21ba7/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:02.384500 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.385465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.385670 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.402162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.404198 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:02.429630 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] MFA Rules not processed for user `577b518bf55847f191fb5260bca21ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:02.431209 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:02.482854 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd2e-e4c5-44d9-b664-a10f393d9941 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.488081 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.488953 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.489267 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.489548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] PATH_INFO: `/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.490760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6227b79fb3f74d89ae0639b4924ae8f3)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.492717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.499732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1392/2744] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:02.504189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.514560 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e13bb-d3b5-49f6-b97f-015357378c1b None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.519091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.520216 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.520575 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.520853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.521843 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.523993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.525036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:02.545997 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6227b79fb3f74d89ae0639b4924ae8f3', 'request_id': 'req-1460edd3-06ff-4ef2-9d8d-8bae1245033b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.552135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6227b79fb3f74d89ae0639b4924ae8f3', 'request_id': 'req-1460edd3-06ff-4ef2-9d8d-8bae1245033b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.553533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1393/2745] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:46:02.557115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.563808 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6227b79fb3f74d89ae0639b4924ae8f3', 'request_id': 'req-1460edd3-06ff-4ef2-9d8d-8bae1245033b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.576146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] The token cache is being invalidate because project 6227b79fb3f74d89ae0639b4924ae8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:02.576518 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.577278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:02.579051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1353/2746] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:02 2022] DELETE /identity/v3/projects/6227b79fb3f74d89ae0639b4924ae8f3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:02.613011 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:02.626534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a0590-f028-4d8a-9f7c-6fd813f25a1f admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.631978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.632677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.632964 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.633269 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.633985 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.636682 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.660977 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1394/2747] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:46:02.664916 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.666730 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:02.740074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460edd3-06ff-4ef2-9d8d-8bae1245033b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.745405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.746106 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.746390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.746661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.747427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.749054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.764178 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1354/2748] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:02.765764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.778028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bf941-f608-4102-93d7-c6543dca0493 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.783224 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.784186 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.784473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.784754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] PATH_INFO: `/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7/users/c28196e5c149400e9dfd0b0174e7366e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.801981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c831ed567fe5480cb72ecf0d6969b9f7, user_id=c28196e5c149400e9dfd0b0174e7366e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.804695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.820034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1395/2749] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:02 2022] PUT /identity/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7/users/c28196e5c149400e9dfd0b0174e7366e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:02.824767 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.835520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fec86-d303-4c9c-a670-f3eb936d8f70 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.892508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.893092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.893402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.893677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.894423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.896102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2963fa1-8d02-4762-8a8f-863bcb67e480 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.907016 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1355/2750] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:02.911322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:02.921969 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d3bf-345b-4f84-a23b-686487f1548b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:02.926539 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:02.927416 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.927698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.927973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] PATH_INFO: `/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7/users/c28196e5c149400e9dfd0b0174e7366e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.929940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c831ed567fe5480cb72ecf0d6969b9f7, user_id=c28196e5c149400e9dfd0b0174e7366e, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:02.932582 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:02.942830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1396/2751] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:02 2022] PUT /identity/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7/users/c28196e5c149400e9dfd0b0174e7366e/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:02.954491 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:02.954786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:02.955065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:02.982057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] MFA Rules not processed for user `c28196e5c149400e9dfd0b0174e7366e`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:02.983278 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:03.019571 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:03.058152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1356/2752] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:03.068703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:03.070417 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:03.151007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641f56c-bef3-455b-8fa4-116c30d109bb admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:03.156895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:03.158050 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:03.158568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:03.159076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:03.173203 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:03.174687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a0078-56cc-4259-9ac8-ba010caad4c8 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:03.185277 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1397/2753] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:04.503835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:04.567316 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a76b-e848-4e24-8abc-a69fab5994ce None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:04.571858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:04.573476 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:04.573757 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:04.574028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] PATH_INFO: `/v3/users/577b518bf55847f191fb5260bca21ba7` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:04.575243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] RBAC: Authorizing `identity:delete_user(user_id=577b518bf55847f191fb5260bca21ba7)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:04.577167 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:04.624706 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577b518bf55847f191fb5260bca21ba7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:04.632697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577b518bf55847f191fb5260bca21ba7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:04.640820 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577b518bf55847f191fb5260bca21ba7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:04.653470 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577b518bf55847f191fb5260bca21ba7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:04.654179 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577b518bf55847f191fb5260bca21ba7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:04.660718 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1357/2754] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:04 2022] DELETE /identity/v3/users/577b518bf55847f191fb5260bca21ba7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:04.665557 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:04.666698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:04.666698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:04.685521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:04.686839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:04.746143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1398/2755] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:04.755911 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:04.757345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:04.815230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86ff06-7c87-4c0c-8d06-a3a4e4a1521c admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:04.818876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:04.819513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:04.819791 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:04.820070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:04.826102 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:04.830662 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:04.832155 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:04.843608 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1358/2756] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:05.125081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:05.126948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:05.142099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153da508-b717-4053-b5c2-37f07aabea29 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:05.146966 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:05.148027 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:05.148325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:05.148576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] PATH_INFO: `/v3/projects/7bfcd7bc516549319872e88ee2fa7958` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:05.149788 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bfcd7bc516549319872e88ee2fa7958)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:05.152280 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:05.208129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:05.221715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bfcd7bc516549319872e88ee2fa7958', 'request_id': 'req-9f089ed6-daac-4578-b150-1dddb92e1920'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.227704 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bfcd7bc516549319872e88ee2fa7958', 'request_id': 'req-9f089ed6-daac-4578-b150-1dddb92e1920'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.235865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bfcd7bc516549319872e88ee2fa7958', 'request_id': 'req-9f089ed6-daac-4578-b150-1dddb92e1920'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.252885 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] The token cache is being invalidate because project 7bfcd7bc516549319872e88ee2fa7958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:05.253177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.253863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.259452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1399/2757] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:05 2022] DELETE /identity/v3/projects/7bfcd7bc516549319872e88ee2fa7958 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:05.260715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:05.273436 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507dd8e-63c4-41f7-b2c6-88f04c96ef5c service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:05.334747 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:05.335635 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:05.335918 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:05.336195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] PATH_INFO: `/v3/users/c28196e5c149400e9dfd0b0174e7366e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:05.338184 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28196e5c149400e9dfd0b0174e7366e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:05.340055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:05.387542 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28196e5c149400e9dfd0b0174e7366e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.394462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28196e5c149400e9dfd0b0174e7366e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.402625 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28196e5c149400e9dfd0b0174e7366e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.416540 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28196e5c149400e9dfd0b0174e7366e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.417821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-34b642fd-b747-4798-aa10-db3a7f9961f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28196e5c149400e9dfd0b0174e7366e'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.423857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1359/2758] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:05 2022] DELETE /identity/v3/users/c28196e5c149400e9dfd0b0174e7366e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:46:05.696298 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:05.698486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:05.711870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f089ed6-daac-4578-b150-1dddb92e1920 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:05.776656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:05.777702 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:05.778072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:05.778370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] PATH_INFO: `/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:05.779569 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c831ed567fe5480cb72ecf0d6969b9f7)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:05.781533 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:05.833655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c831ed567fe5480cb72ecf0d6969b9f7', 'request_id': 'req-35a2c630-0088-4c61-83e8-677b958941bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.839955 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c831ed567fe5480cb72ecf0d6969b9f7', 'request_id': 'req-35a2c630-0088-4c61-83e8-677b958941bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.846134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c831ed567fe5480cb72ecf0d6969b9f7', 'request_id': 'req-35a2c630-0088-4c61-83e8-677b958941bb'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.862205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] The token cache is being invalidate because project c831ed567fe5480cb72ecf0d6969b9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:05.862499 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.863144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-35a2c630-0088-4c61-83e8-677b958941bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:05.864992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1400/2759] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:05 2022] DELETE /identity/v3/projects/c831ed567fe5480cb72ecf0d6969b9f7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:05.870036 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:05.870548 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:05.870992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:05.890993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:05.892186 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:05.953963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1360/2760] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:05.961590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:05.961827 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:05.962100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:05.980783 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:05.982004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:05.990284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1401/2761] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:05.994941 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.004756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc89f2b-fd88-44ac-89c7-22bee35f1b37 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.009460 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.010825 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.011111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.011395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.012153 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:46:06.012584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.014515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.023300 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.027080 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1361/2762] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:46:06.031671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.041238 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9b95-90e8-49a2-a52f-0e96c3f88617 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.045836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.046477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.046757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.047028 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.047717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.049624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.075614 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1402/2763] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:46:06.079829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.091073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d59b-f619-4b89-9cb8-79261ead7ba8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.149065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.150725 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.151215 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.151741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.152992 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.155756 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.175930 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1362/2764] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:06.180177 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.194151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee88e-01a4-4a23-ad34-489308a4b897 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.200524 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.201212 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.201489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.201764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.202482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.204075 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.215795 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1403/2765] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:06.219829 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.230595 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631289c8-90f3-4d23-9eb1-1922a61b1b54 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.236103 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.237060 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.237376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.237652 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.238394 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.240061 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51296fa3-777e-4759-b677-53f59d480cd8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.250146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1363/2766] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:06.254179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.264296 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787f0d4-c060-40c0-bf65-556217ac320c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.268863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.269799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.270080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.270354 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] PATH_INFO: `/v3/projects/f2706c032b3247e5abc9541dd71aabf4/users/707d870a04c24ab896c136777435b135/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.285612 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2706c032b3247e5abc9541dd71aabf4, user_id=707d870a04c24ab896c136777435b135, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.288225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.291905 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.308339 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1404/2767] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:06 2022] PUT /identity/v3/projects/f2706c032b3247e5abc9541dd71aabf4/users/707d870a04c24ab896c136777435b135/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:46:06.319515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.319809 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.320097 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.346696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] MFA Rules not processed for user `707d870a04c24ab896c136777435b135`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:06.347909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:06.418650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1364/2768] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:06.423263 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.488814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a865e2-eab8-40bb-8c8d-258738c26457 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.493460 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.494344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.494772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.495054 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.495757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.497705 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.522678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1405/2769] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:06.527976 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.538810 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda139a-0825-4e30-94f7-b996eba1a1c3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.595388 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.596059 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.596372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.596650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.597375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.599280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.613577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.619667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1365/2770] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:06.623603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.634199 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0949f-f258-44f1-ae8e-7ad97a27d71e admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.639917 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.640571 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.640876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.641130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.641878 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.643468 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.656083 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1406/2771] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:06.660289 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.670696 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea3864-9684-4e2a-a117-904c978094f5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.675449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.676325 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.676606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.676879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] PATH_INFO: `/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd/users/6c3468800b044aa09a06f63cb877004f/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.691445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffb8352d39d4b25a0441ee43c4304fd, user_id=6c3468800b044aa09a06f63cb877004f, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.694127 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.707692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1366/2772] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:06 2022] PUT /identity/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd/users/6c3468800b044aa09a06f63cb877004f/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:46:06.711742 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.721876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d368-978d-4240-870b-6b4284489201 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.783205 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.783909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.784190 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.784459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.785211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.786790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6747b-fcea-4baf-83fb-d9ab9898f55a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.797179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1407/2773] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:06.801407 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.812458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e3d9c-66b9-434d-a22a-1d9d12389bdb admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:06.817042 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:06.817945 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.818225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.818497 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] PATH_INFO: `/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd/users/6c3468800b044aa09a06f63cb877004f/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.820442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ffb8352d39d4b25a0441ee43c4304fd, user_id=6c3468800b044aa09a06f63cb877004f, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:06.824266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:06.834395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1367/2774] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:06 2022] PUT /identity/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd/users/6c3468800b044aa09a06f63cb877004f/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:06.844739 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:06.845057 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:06.845362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:06.871895 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] MFA Rules not processed for user `6c3468800b044aa09a06f63cb877004f`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:06.873091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:06.926973 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:06.948379 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1408/2775] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:06.959311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:06.961089 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:07.020375 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c889b4-9a0e-43fa-8e3c-039d4517bf28 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:07.024378 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:07.025573 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.025985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.026270 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.035760 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:07.037131 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589ee67-69df-4073-96e1-c17ee3097643 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:07.047366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1368/2776] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:07.123943 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:07.188583 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e889-9238-43ac-8e29-75666c83fbc3 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:07.193587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:07.194998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.194998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.195305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] PATH_INFO: `/v3/users/707d870a04c24ab896c136777435b135` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.196344 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707d870a04c24ab896c136777435b135)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:07.199095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:07.256362 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707d870a04c24ab896c136777435b135'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.263998 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707d870a04c24ab896c136777435b135'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.271380 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707d870a04c24ab896c136777435b135'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.272077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707d870a04c24ab896c136777435b135'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.284512 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707d870a04c24ab896c136777435b135'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.291570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1409/2777] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:07 2022] DELETE /identity/v3/users/707d870a04c24ab896c136777435b135 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:07.296464 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.296751 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.297055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.315447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:07.316649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:07.381345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1369/2778] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:07.391079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:07.392481 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:07.450005 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bb777-3e3f-4172-9b2b-1e8f4da64af4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:07.453673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:07.454322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.454605 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.454882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.464546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:07.465992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:07.475445 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1410/2779] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:07.744187 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:07.745681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:07.758799 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad13164-d689-45c5-ac4b-ed808152307e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:07.764048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:07.764983 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.765305 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.765588 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] PATH_INFO: `/v3/projects/f2706c032b3247e5abc9541dd71aabf4` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.766786 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2706c032b3247e5abc9541dd71aabf4)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:07.768698 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:07.818413 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2706c032b3247e5abc9541dd71aabf4', 'request_id': 'req-068c723a-72ad-42c7-962f-233c00cbf572'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.823845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2706c032b3247e5abc9541dd71aabf4', 'request_id': 'req-068c723a-72ad-42c7-962f-233c00cbf572'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.825739 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:07.832348 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2706c032b3247e5abc9541dd71aabf4', 'request_id': 'req-068c723a-72ad-42c7-962f-233c00cbf572'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.844926 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] The token cache is being invalidate because project f2706c032b3247e5abc9541dd71aabf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:07.845239 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.845869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.847396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1370/2780] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:07 2022] DELETE /identity/v3/projects/f2706c032b3247e5abc9541dd71aabf4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:07.851448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:07.862478 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9c22f-e3b8-4aaa-bf5b-6d26ec61ec6c service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:07.871076 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:07.921532 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:07.922412 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:07.922698 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:07.922979 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] PATH_INFO: `/v3/users/6c3468800b044aa09a06f63cb877004f` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:07.924172 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3468800b044aa09a06f63cb877004f)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:07.926202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:07.971872 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3468800b044aa09a06f63cb877004f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.979135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3468800b044aa09a06f63cb877004f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.985924 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3468800b044aa09a06f63cb877004f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.986555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3468800b044aa09a06f63cb877004f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:07.999213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-d90cf11f-aef1-41f7-bcc0-ae8ec14c799f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3468800b044aa09a06f63cb877004f'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.004960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1411/2781] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:07 2022] DELETE /identity/v3/users/6c3468800b044aa09a06f63cb877004f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:08.283055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.284537 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:08.301606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c723a-72ad-42c7-962f-233c00cbf572 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.359852 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.360638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.360920 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.361210 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] PATH_INFO: `/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.362723 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ffb8352d39d4b25a0441ee43c4304fd)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.364612 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.415931 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ffb8352d39d4b25a0441ee43c4304fd', 'request_id': 'req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.421602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ffb8352d39d4b25a0441ee43c4304fd', 'request_id': 'req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.429843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ffb8352d39d4b25a0441ee43c4304fd', 'request_id': 'req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.442423 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] The token cache is being invalidate because project 9ffb8352d39d4b25a0441ee43c4304fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:08.442715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.443350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-28a9c7c6-2b2a-4438-a0f8-870f0f2005e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:08.444895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1371/2782] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:08 2022] DELETE /identity/v3/projects/9ffb8352d39d4b25a0441ee43c4304fd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:08.450825 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.451142 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.451424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.470150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:08.470853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:08.547127 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1412/2783] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:08.549351 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.549650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.549957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.571729 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:08.573477 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:08.581513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1372/2784] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:08.586248 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.596980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c77b-ae10-4edc-a0f6-fca5b3d258db None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.601594 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.602259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.602542 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.602814 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.603873 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:46:08.604184 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.605845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.622234 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1413/2785] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:46:08.623633 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.632894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087f66-ad81-4e64-a372-a77f79751576 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.638967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.639622 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.639903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.640176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.640862 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.642784 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.672598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1373/2786] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:08 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:08.673848 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.684761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e680-9f5f-4d20-a59d-f301c2fbf16a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.702984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:08.746410 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.747093 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.747381 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.747655 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.748350 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.750323 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.770432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1414/2787] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:08 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:08.774634 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.784995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611304-65f7-4f4b-a866-51304060e4df admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.789836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.790498 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.791317 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.791591 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.792310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.794322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.805538 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1374/2788] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:08.810422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.821341 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81253d-be3c-4bee-987a-ff9b1a3266bd admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.826394 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.827059 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.827338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.827610 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.828452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.830306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaee1ab-4f7e-428a-af63-8ef03863a060 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.840469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1415/2789] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:08.844702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:08.856032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e611d-7dd1-4d14-ad11-649ec7e7d92b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:08.860821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:08.862099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.862376 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.862648 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] PATH_INFO: `/v3/projects/14cd6b81646048caa6098ad83afc628f/users/0d89bf601818462fbbf4c424c1ba5f87/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.877824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cd6b81646048caa6098ad83afc628f, user_id=0d89bf601818462fbbf4c424c1ba5f87, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:08.880386 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:08.893438 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1375/2790] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:08 2022] PUT /identity/v3/projects/14cd6b81646048caa6098ad83afc628f/users/0d89bf601818462fbbf4c424c1ba5f87/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:08.907369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:08.908328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:08.908616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:08.945168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] MFA Rules not processed for user `0d89bf601818462fbbf4c424c1ba5f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:08.946456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:09.048839 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1416/2791] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:09.053381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.069479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:09.139096 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ac5e5-637a-4d8c-8d0a-dfa3025303a2 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.144119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.144788 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.145075 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.145382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.146092 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.148002 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.173940 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1376/2792] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:09 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:09.178048 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.189292 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff8b3-e714-41b0-bf04-894643070eb6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.247388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.248061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.248340 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.248616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.249325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.251230 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.271097 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1417/2793] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:09 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:09.275124 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.285541 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192059c3-c158-4aa0-8c1f-57b102fa08b6 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.290088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.291269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.291554 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.291831 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.292597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.294443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.304935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1377/2794] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:09.309717 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.319473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe0f18-6f8f-4cb6-91cd-53450e5ed97a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.325268 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.326153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.326424 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.326696 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] PATH_INFO: `/v3/projects/fae173558b964e33b43de2b8c65bbbaf/users/25b8a24b8d8a4bfda0389d3a1c6f59f2/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.342984 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae173558b964e33b43de2b8c65bbbaf, user_id=25b8a24b8d8a4bfda0389d3a1c6f59f2, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.345930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.348272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:09.362306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1418/2795] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:09 2022] PUT /identity/v3/projects/fae173558b964e33b43de2b8c65bbbaf/users/25b8a24b8d8a4bfda0389d3a1c6f59f2/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:09.366611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.380503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65315-a64d-4f09-b50b-3a5a16c565c9 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.446064 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.446661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.446946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.447224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.448139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.449935 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef06248-eef9-455c-86ee-2a7de754a395 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.463843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1378/2796] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:09.465527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.475836 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083100b-96e3-42f8-b5e6-40f0d59f5ac9 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.481988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.483013 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.483901 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.484215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] PATH_INFO: `/v3/projects/fae173558b964e33b43de2b8c65bbbaf/users/25b8a24b8d8a4bfda0389d3a1c6f59f2/roles/b37eee20ec3e44b0b0d9e8ee60318b0b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.487007 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae173558b964e33b43de2b8c65bbbaf, user_id=25b8a24b8d8a4bfda0389d3a1c6f59f2, role_id=b37eee20ec3e44b0b0d9e8ee60318b0b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.489752 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.501138 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1419/2797] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:09 2022] PUT /identity/v3/projects/fae173558b964e33b43de2b8c65bbbaf/users/25b8a24b8d8a4bfda0389d3a1c6f59f2/roles/b37eee20ec3e44b0b0d9e8ee60318b0b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:09.511669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd20d1-c923-4bd4-acb1-a49edde67f77 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.511961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd20d1-c923-4bd4-acb1-a49edde67f77 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.512236 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd20d1-c923-4bd4-acb1-a49edde67f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.538396 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-10cd20d1-c923-4bd4-acb1-a49edde67f77 None None] MFA Rules not processed for user `25b8a24b8d8a4bfda0389d3a1c6f59f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:09.539720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-10cd20d1-c923-4bd4-acb1-a49edde67f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:09.623121 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1379/2798] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:09.636197 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.638049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:09.698262 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f760ac5-b2a1-486a-a98f-1d7ae639f8ca admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.702214 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.702703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.702861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.702978 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.703146 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.703255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.703421 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.713576 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.715063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.721589 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:09.722802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:09.724958 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1420/2799] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:09.727209 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:09.782271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1380/2800] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:46:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:46:09.804603 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.814426 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3ffa8-9806-4b90-8fe6-07dd94f64132 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.818677 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.819409 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.819713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.819989 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.831905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:09.833308 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:09.881423 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.882858 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b660491-1027-4f8b-ade6-b612644a7dd1 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.892671 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1421/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:09.906496 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d12b2-a790-44dc-afbd-df8d81aed298 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:09.912223 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:09.912881 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:09.913171 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:09.913473 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:09.922225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:09.923833 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:09.932731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1381/2802] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 23:46:10.466144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bcae-c705-4903-a30e-94866ebe126b None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:10.466658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bcae-c705-4903-a30e-94866ebe126b None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:10.466781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bcae-c705-4903-a30e-94866ebe126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:10.484472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4161bcae-c705-4903-a30e-94866ebe126b None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:10.485790 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4161bcae-c705-4903-a30e-94866ebe126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:10.493213 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1422/2803] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:46:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:10.505968 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:10.517164 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8e463-519e-4bd2-b234-c4a697a446c4 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:10.522150 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:10.522790 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:10.523057 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:10.523331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:10.532374 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:10.534028 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:10.543043 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1382/2804] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:10.729602 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740046c-fc39-4b78-a857-a33f336a2a06 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:10.729890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740046c-fc39-4b78-a857-a33f336a2a06 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:10.730169 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740046c-fc39-4b78-a857-a33f336a2a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:10.747928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-2740046c-fc39-4b78-a857-a33f336a2a06 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:10.749095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2740046c-fc39-4b78-a857-a33f336a2a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:10.756436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1423/2805] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:46:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:10.768065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:10.779157 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773609a2-a166-4a40-b507-5ac95db7ad57 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:10.784257 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:10.784892 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:10.785174 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:10.785478 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:10.794128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:10.795700 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:10.804108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1383/2806] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:11.118321 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:11.118811 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:11.118947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:11.139139 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:11.140363 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:11.147940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1424/2807] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:46:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:11.160714 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:11.171543 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3aeb6-bead-47f1-afbb-9da778af59a9 service swift] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:11.176427 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:11.177051 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:11.177382 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:11.177638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:11.185586 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:11.187142 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821eeb34-34c7-4ed5-bb98-bf8e62199215 service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:11.195212 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1384/2808] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:46:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:13.279994 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:13.281465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:13.355452 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a82082-4bb9-4627-9fdb-9218e8ec7b95 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:13.359940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:13.360803 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:13.361085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:13.361395 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] PATH_INFO: `/v3/users/6210ff430cd14131a89521868685293b` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:13.363115 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6210ff430cd14131a89521868685293b)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:13.365026 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:13.367733 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:13.415087 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6210ff430cd14131a89521868685293b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.424462 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6210ff430cd14131a89521868685293b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.434724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6210ff430cd14131a89521868685293b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.435449 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6210ff430cd14131a89521868685293b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.448284 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6210ff430cd14131a89521868685293b'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.454252 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1425/2809] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:13 2022] DELETE /identity/v3/users/6210ff430cd14131a89521868685293b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:13.458676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:13.459135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:13.459261 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:13.477474 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:13.479315 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:13.539504 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1385/2810] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:13.550109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:13.551518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:13.612215 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf4bf-23ec-486a-9e0c-17394ea13750 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:13.616124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:13.616776 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:13.617056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:13.617365 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:13.627145 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:13.628573 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:13.638463 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1426/2811] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:46:13.811183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:13.812645 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:13.822606 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=100 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:13.826936 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53265-bd8a-48e5-b917-c60b462b8b73 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:13.831900 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:13.832891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:13.833176 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:13.833480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] PATH_INFO: `/v3/projects/3c886fb492cd4514a0bec0539875831e` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:13.834658 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c886fb492cd4514a0bec0539875831e)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:13.836719 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:13.884954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c886fb492cd4514a0bec0539875831e', 'request_id': 'req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.890894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c886fb492cd4514a0bec0539875831e', 'request_id': 'req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.898553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c886fb492cd4514a0bec0539875831e', 'request_id': 'req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.910843 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] The token cache is being invalidate because project 3c886fb492cd4514a0bec0539875831e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:13.911195 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.911813 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-1b0b7d16-1f49-4261-bd1b-ed898a8b42ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:13.913392 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1386/2812] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:13 2022] DELETE /identity/v3/projects/3c886fb492cd4514a0bec0539875831e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:14.615303 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:14.616720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:14.629509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbbf43-9d5a-48cf-9a04-6556b967c757 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:14.685556 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:14.686428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:14.686712 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:14.686988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] PATH_INFO: `/v3/users/0d89bf601818462fbbf4c424c1ba5f87` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:14.688189 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d89bf601818462fbbf4c424c1ba5f87)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:14.690131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:14.718722 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:14.737320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d89bf601818462fbbf4c424c1ba5f87'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:14.744953 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d89bf601818462fbbf4c424c1ba5f87'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:14.751963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d89bf601818462fbbf4c424c1ba5f87'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:14.752598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d89bf601818462fbbf4c424c1ba5f87'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:14.764851 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d89bf601818462fbbf4c424c1ba5f87'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:14.770658 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1427/2813] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:14 2022] DELETE /identity/v3/users/0d89bf601818462fbbf4c424c1ba5f87 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:14.775753 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:14.776237 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:14.776335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:14.793670 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:14.794875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:14.851966 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1387/2814] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:14.862530 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:14.863968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:14.925033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68cd9-bb9e-4dbf-96cf-f81fc6f84483 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:14.928748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:14.929436 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:14.929723 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:14.930002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:14.939857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:14.941393 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:14.950972 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1428/2815] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:46:15.220727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:15.222197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:15.236894 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eef93-2b15-41f3-89a3-d264129becd3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:15.242705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:15.243584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:15.243869 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:15.244147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] PATH_INFO: `/v3/projects/14cd6b81646048caa6098ad83afc628f` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:15.245568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cd6b81646048caa6098ad83afc628f)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:15.247885 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:15.295435 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cd6b81646048caa6098ad83afc628f', 'request_id': 'req-31f88b2b-90a5-4543-adf0-717b6e56ee2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.301139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cd6b81646048caa6098ad83afc628f', 'request_id': 'req-31f88b2b-90a5-4543-adf0-717b6e56ee2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.308387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cd6b81646048caa6098ad83afc628f', 'request_id': 'req-31f88b2b-90a5-4543-adf0-717b6e56ee2b'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.319409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] The token cache is being invalidate because project 14cd6b81646048caa6098ad83afc628f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:15.319697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.320310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.321857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1388/2816] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:15 2022] DELETE /identity/v3/projects/14cd6b81646048caa6098ad83afc628f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:15.326388 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:15.335929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad572b-6eec-430d-a1f7-0c816fe83aca service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:15.389993 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:15.390857 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:15.391135 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:15.391406 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] PATH_INFO: `/v3/users/25b8a24b8d8a4bfda0389d3a1c6f59f2` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:15.392568 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b8a24b8d8a4bfda0389d3a1c6f59f2)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:15.394486 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:15.439124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b8a24b8d8a4bfda0389d3a1c6f59f2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.440735 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:15.446456 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b8a24b8d8a4bfda0389d3a1c6f59f2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.455935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b8a24b8d8a4bfda0389d3a1c6f59f2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.456555 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b8a24b8d8a4bfda0389d3a1c6f59f2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.468938 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-66e984ca-5707-43ff-aa67-0f15ea2e4199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b8a24b8d8a4bfda0389d3a1c6f59f2'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.475004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1429/2817] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:46:15 2022] DELETE /identity/v3/users/25b8a24b8d8a4bfda0389d3a1c6f59f2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:15.736793 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:15.738311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:15.752118 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f88b2b-90a5-4543-adf0-717b6e56ee2b admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:15.760094 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:15.812238 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:15.813101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:15.813523 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:15.813807 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] PATH_INFO: `/v3/projects/fae173558b964e33b43de2b8c65bbbaf` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:15.814975 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae173558b964e33b43de2b8c65bbbaf)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:15.816934 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:15.863458 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae173558b964e33b43de2b8c65bbbaf', 'request_id': 'req-6944ddea-412b-49ce-93b7-f529b7bc91b6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.868863 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae173558b964e33b43de2b8c65bbbaf', 'request_id': 'req-6944ddea-412b-49ce-93b7-f529b7bc91b6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.877045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae173558b964e33b43de2b8c65bbbaf', 'request_id': 'req-6944ddea-412b-49ce-93b7-f529b7bc91b6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.888981 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] The token cache is being invalidate because project fae173558b964e33b43de2b8c65bbbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:46:15.889291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.889907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-6944ddea-412b-49ce-93b7-f529b7bc91b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:46:15.891429 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1389/2818] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:46:15 2022] DELETE /identity/v3/projects/fae173558b964e33b43de2b8c65bbbaf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:15.896435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:15.896988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:15.897131 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:15.917033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:15.918338 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:15.975912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1430/2819] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:15.984310 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:15.984598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:15.984875 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.003901 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:16.005085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:16.014828 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1390/2820] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:16.018692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.029165 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abce505-a3ae-4041-b47f-ecea572889d8 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.033796 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.034450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.034732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.035008 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.035732 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:46:16.036039 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.037694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.049521 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1431/2821] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 23:46:16.054049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.063842 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbe92d-6497-41a1-b138-64dba2732002 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.068530 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.069108 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.069418 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.069691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.070364 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.072272 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.099321 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1391/2822] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:46:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:16.103466 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.114056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d87ab-ad4b-4f13-973a-4a4bf0888316 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.170799 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.171470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.171751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.172024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.172736 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.174665 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.194246 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1432/2823] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:46:16 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:46:16.199180 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.210311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5fea-ba44-440e-9ef6-9a5c341fc244 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.215919 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.216574 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.216855 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.217125 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.217879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.219462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.230225 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1392/2824] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:16.234271 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.244531 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c1e2-e397-4d96-8a7c-73a91cdf5e0c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.249279 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.249948 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.250233 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.250511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.251270 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.252853 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2485040-a364-4365-939f-9d435d748193 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.263225 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1433/2825] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:46:16.267162 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.277814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001c1f8-33aa-496b-a63e-63670d8c9288 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.282414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.283288 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.283570 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.283872 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] PATH_INFO: `/v3/projects/003a186a40794519802dd209eeb034c3/users/793e1f8bb3454ff8964bb78200d75de6/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.298362 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=003a186a40794519802dd209eeb034c3, user_id=793e1f8bb3454ff8964bb78200d75de6, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.301065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.313868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1393/2826] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:46:16 2022] PUT /identity/v3/projects/003a186a40794519802dd209eeb034c3/users/793e1f8bb3454ff8964bb78200d75de6/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:46:16.318909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6dc9-46ed-4d36-991a-727a8e92c408 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.319143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6dc9-46ed-4d36-991a-727a8e92c408 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.319422 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6dc9-46ed-4d36-991a-727a8e92c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.337369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a92e6dc9-46ed-4d36-991a-727a8e92c408 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:16.338570 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a92e6dc9-46ed-4d36-991a-727a8e92c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:16.364081 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:16.398432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1434/2827] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 23:46:16.408792 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:16.410509 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:16.452731 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:16.470340 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a190b-1e86-4781-9078-aa2f56df0fba admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:16.473905 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:16.474546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:16.474823 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:16.475099 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:16.484402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:16.485858 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:16.495569 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1394/2828] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:17.125328 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ab52-741a-4e54-9989-fd54df329b80 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:17.125840 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ab52-741a-4e54-9989-fd54df329b80 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:17.125968 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ab52-741a-4e54-9989-fd54df329b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:17.153080 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-a161ab52-741a-4e54-9989-fd54df329b80 None None] MFA Rules not processed for user `793e1f8bb3454ff8964bb78200d75de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:17.154347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-a161ab52-741a-4e54-9989-fd54df329b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:17.223947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1435/2829] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:17.235332 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:17.237074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:17.294768 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e23ed-0148-45fb-80df-ba7ef8191f24 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:17.298350 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:17.299054 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:17.299345 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:17.299620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:17.311101 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:17.312597 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283b924-b216-4791-8636-a323fddc6b46 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:17.322030 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1395/2830] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:18.657061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:18.657625 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:18.657729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:18.675593 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] MFA Rules not processed for user `793e1f8bb3454ff8964bb78200d75de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:18.676800 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:18.684523 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1436/2831] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:27.317759 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=35 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:28.670322 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=48 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:30.376213 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:30.376727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:30.376835 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:30.404166 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] MFA Rules not processed for user `793e1f8bb3454ff8964bb78200d75de6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:30.405380 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:30.428857 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1396/2832] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:40.426937 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=15 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:46:42.261587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:42.263023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:42.413601 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e006e4-a9a4-4a04-a4bc-23ae3f54b7e6 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:42.420921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:42.421623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:42.421995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:42.422272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:42.424232 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:42.436794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:42.438472 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da079b-7fea-4caf-b62e-d6952e2ec46b service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:42.454004 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1437/2833] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:45.865954 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:45.867395 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:45.879850 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2d395-16b9-4178-8a88-cc1212e5d21e None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:45.883417 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:45.884045 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:45.884334 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:45.884610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:45.887019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:45.945903 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:45.947948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:45.957147 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1397/2834] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:46:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:46:50.610150 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873c53-a97d-4ddc-9409-444965f15f90 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:50.610912 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873c53-a97d-4ddc-9409-444965f15f90 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:50.611012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873c53-a97d-4ddc-9409-444965f15f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:50.640632 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8e873c53-a97d-4ddc-9409-444965f15f90 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:50.642094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8e873c53-a97d-4ddc-9409-444965f15f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:50.708794 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1438/2835] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 23:46:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:46:50.722073 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:46:50.723536 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:50.795328 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bbc4c-c3e4-49b3-9dd6-097f59d7b445 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:46:50.800368 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:46:50.801019 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:50.801353 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:50.801636 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:50.809802 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:46:50.811402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33863c2-c4f7-4b04-8b1f-d294c33b14fe service swift] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:46:50.819453 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1398/2836] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:46:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:46:52.796153 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e136-5aa0-491b-81af-10243a31125f None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:46:52.796755 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e136-5aa0-491b-81af-10243a31125f None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:46:52.796863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942e136-5aa0-491b-81af-10243a31125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:46:52.816162 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-b942e136-5aa0-491b-81af-10243a31125f None None] MFA Rules not processed for user `26738ea4f6d54d7d81f1ec5057c237ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:46:52.817565 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b942e136-5aa0-491b-81af-10243a31125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:46:52.825551 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1439/2837] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:46:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:00.816330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=60 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:02.810049 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=98 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:05.784197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:05.784703 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:05.784804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:05.803254 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] MFA Rules not processed for user `1352bc3b2bcd474b920ff7cd151e445a`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:05.804483 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:05.813488 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1399/2838] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 23:47:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:05.829343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942e136-5aa0-491b-81af-10243a31125f None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:05.842473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942e136-5aa0-491b-81af-10243a31125f None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:05.847935 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '152e60dec2154281b85d5626fd836813', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:05.848667 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:05.849024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:05.849400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:05.859151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:05.861099 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:05.871772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1440/2839] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 23:47:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 23:47:07.884961 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:07.917329 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f403518-c72a-40be-aad0-8eb4cb6e45f3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:07.922104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:07.922971 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:07.923255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:07.923533 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] PATH_INFO: `/v3/users/793e1f8bb3454ff8964bb78200d75de6` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:07.924732 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=793e1f8bb3454ff8964bb78200d75de6)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:07.926680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:07.972451 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '793e1f8bb3454ff8964bb78200d75de6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:07.980479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '793e1f8bb3454ff8964bb78200d75de6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:07.987814 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '793e1f8bb3454ff8964bb78200d75de6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.000013 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '793e1f8bb3454ff8964bb78200d75de6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.000646 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-a852b978-b45c-44f8-adcd-9b189b3a07e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '793e1f8bb3454ff8964bb78200d75de6'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.006442 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1400/2840] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:47:07 2022] DELETE /identity/v3/users/793e1f8bb3454ff8964bb78200d75de6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:47:08.246002 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.256925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57248eb-8376-4749-92d4-e8480506ecc9 service swift] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.330775 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.331561 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.331845 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.332120 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] PATH_INFO: `/v3/projects/003a186a40794519802dd209eeb034c3` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.333400 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003a186a40794519802dd209eeb034c3)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.335290 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.382325 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003a186a40794519802dd209eeb034c3', 'request_id': 'req-41a4c28f-441f-4316-80f4-ab6ae7246c04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.388482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003a186a40794519802dd209eeb034c3', 'request_id': 'req-41a4c28f-441f-4316-80f4-ab6ae7246c04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.394489 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003a186a40794519802dd209eeb034c3', 'request_id': 'req-41a4c28f-441f-4316-80f4-ab6ae7246c04'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.420734 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] The token cache is being invalidate because project 003a186a40794519802dd209eeb034c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:47:08.421140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.421898 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-41a4c28f-441f-4316-80f4-ab6ae7246c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:08.423909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1441/2841] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:47:08 2022] DELETE /identity/v3/projects/003a186a40794519802dd209eeb034c3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:47:08.428822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.429112 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.429440 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.489119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:08.490421 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:08.548660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1401/2842] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:08.556483 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.556806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.557109 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.575104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:08.576306 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:08.584295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1442/2843] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:08.588389 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.598066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71517ab8-a130-4a2c-9d19-eed15c4775c9 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.602677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.603896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.604354 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.604653 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.605397 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:47:08.605705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.607335 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.619874 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1402/2844] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:47:08.624012 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.633085 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef60a63-0118-4bf5-a263-9cf80e318479 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.638061 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.638716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.638997 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.639275 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.639963 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.641933 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.668132 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1443/2845] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:47:08 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:47:08.672322 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.683197 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655461ab-e83e-49bd-ab85-f43ace3abc58 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.686770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:08.744741 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.745445 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.745734 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.746012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.746702 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.748615 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.768309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1403/2846] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:47:08 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:47:08.772435 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.782951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b49171-233f-45bc-9f76-c5c7c6d044be admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.787611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.788266 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.788552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.788830 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.789592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.791865 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.801770 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1444/2847] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:47:08.805669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.817026 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fde997-cdf8-4c16-9396-1c8285b270cf admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.821610 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.822853 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.823132 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.823409 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.824128 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.825749 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd8194-54f0-4bf4-951e-6cde95d23d19 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.835618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1404/2848] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:47:08.839681 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:08.849703 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbc805-220a-4b92-93dd-ad9551cade9c admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:08.854902 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:08.855951 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.856241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.856520 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] PATH_INFO: `/v3/projects/f9eb174930134aadb5096b3d71b209a1/users/2f48cfe051394062914f04694f74fe5d/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.871837 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9eb174930134aadb5096b3d71b209a1, user_id=2f48cfe051394062914f04694f74fe5d, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:08.874518 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:08.886765 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1445/2849] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:47:08 2022] PUT /identity/v3/projects/f9eb174930134aadb5096b3d71b209a1/users/2f48cfe051394062914f04694f74fe5d/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:47:08.896547 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:08.897029 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:08.897129 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:08.924508 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] MFA Rules not processed for user `2f48cfe051394062914f04694f74fe5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:08.925794 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:08.989068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1405/2850] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:09.000377 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:09.002134 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:09.005981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:09.085744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81697a-adf5-460c-82b6-01956c5ed7e1 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:09.089720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:09.090370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:09.090651 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:09.090923 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:09.099713 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:09.101144 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:09.111430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1446/2851] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:09.654479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:09.656012 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:09.737678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e2c3-5d4f-44c8-a857-9f827c0ac4e4 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:09.741287 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:09.741933 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:09.742214 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:09.742487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:09.744503 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:09.753369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:09.809761 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:09.811221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4172-d4e2-49dc-9db7-f25390e001e3 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:09.821068 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1406/2852] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:11.676508 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:11.753607 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9dca6-8f8a-4857-9a45-95eba26f48e4 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:11.758944 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:11.759992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:11.760293 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:11.760546 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] PATH_INFO: `/v3/users/2f48cfe051394062914f04694f74fe5d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:11.766079 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f48cfe051394062914f04694f74fe5d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:11.768010 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:11.829971 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f48cfe051394062914f04694f74fe5d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:11.837871 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f48cfe051394062914f04694f74fe5d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:11.847981 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f48cfe051394062914f04694f74fe5d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:11.848692 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f48cfe051394062914f04694f74fe5d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:11.863176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f48cfe051394062914f04694f74fe5d'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:11.871124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1447/2853] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:47:11 2022] DELETE /identity/v3/users/2f48cfe051394062914f04694f74fe5d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:47:11.875515 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:11.875993 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:11.876119 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:11.893836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:11.895000 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:11.961104 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1407/2854] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:11.973278 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:11.975369 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:11.983988 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:12.043694 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94886fcf-7db4-4c22-b4e4-8a3fe8bd5bb4 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.047562 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.048218 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.048511 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.048909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.060509 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.062023 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e14602-7383-44b7-ad0e-2ae38dd126f8 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:12.073440 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1448/2855] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:12.493243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:12.495502 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:12.509762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c461a1d-cd48-4ed1-9c48-279cec2b50cd None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.515083 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.516123 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.516385 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.516668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] PATH_INFO: `/v3/projects/f9eb174930134aadb5096b3d71b209a1` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.517956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9eb174930134aadb5096b3d71b209a1)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.519879 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:12.570387 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9eb174930134aadb5096b3d71b209a1', 'request_id': 'req-bce1e401-5f3a-4591-a03e-e01c44880af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:12.577014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9eb174930134aadb5096b3d71b209a1', 'request_id': 'req-bce1e401-5f3a-4591-a03e-e01c44880af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:12.584764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9eb174930134aadb5096b3d71b209a1', 'request_id': 'req-bce1e401-5f3a-4591-a03e-e01c44880af7'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:12.597266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] The token cache is being invalidate because project f9eb174930134aadb5096b3d71b209a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:47:12.597529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:12.598490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-bce1e401-5f3a-4591-a03e-e01c44880af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:47:12.600697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1408/2856] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:47:12 2022] DELETE /identity/v3/projects/f9eb174930134aadb5096b3d71b209a1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:47:12.606390 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.606687 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.607063 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.627024 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:12.628276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:12.697470 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1449/2857] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:12.755909 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.756291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.756631 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.775844 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:12.777148 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:12.785566 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1409/2858] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:12.789668 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:12.800171 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40e99b-2562-43f2-891f-9a0f70b5bbeb None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.804744 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.805429 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.805715 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.806033 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.807295 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80238) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:47:12.807597 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.809208 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:12.821606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1450/2859] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:47:12.826665 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:12.836601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa045f-d2fa-4464-9623-102f82f67edf None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.841398 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.842049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.842705 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.842985 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.843684 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.845611 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:12.867836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:12.877217 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1410/2860] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:47:12 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:47:12.880194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:12.891102 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45210064-553f-4c4f-a4fc-a3f43f7cf8b5 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.948419 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.949018 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.949337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.949616 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] PATH_INFO: `/v3/users` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.950304 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.952241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:12.972200 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1451/2861] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:47:12 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:47:12.976443 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:12.987490 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ecbf-546e-4d67-bf6b-3840832bc6f8 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:12.992069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:12.992728 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:12.993014 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:12.993326 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:12.994695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:12.996331 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:13.006680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1411/2862] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:47:13.011726 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:13.021547 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce330d8-ee0c-4ff6-93d9-8b50b015dd3a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:13.026552 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:13.027202 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:13.027484 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:13.027756 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:13.028495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:13.030104 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10352a72-5f3c-4fd2-9d2e-f0d1edc8daae admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:13.039870 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1452/2863] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:47:13.044500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:13.054553 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c0d3a-5567-416d-bcc0-e1a5367a1a79 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:13.059414 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:13.060284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:13.060565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:13.060839 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] PATH_INFO: `/v3/projects/1f9a96f2aec2463e9cab476cb103b93a/users/be644b899ffe419485aac64510542000/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:13.075717 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9a96f2aec2463e9cab476cb103b93a, user_id=be644b899ffe419485aac64510542000, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:13.078449 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:13.091715 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1412/2864] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:47:13 2022] PUT /identity/v3/projects/1f9a96f2aec2463e9cab476cb103b93a/users/be644b899ffe419485aac64510542000/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:47:13.097034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5098-46c5-4ee5-bce1-fdcd973531cf None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:13.097432 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5098-46c5-4ee5-bce1-fdcd973531cf None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:13.097716 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5098-46c5-4ee5-bce1-fdcd973531cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:13.116876 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-226d5098-46c5-4ee5-bce1-fdcd973531cf None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:13.118154 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-226d5098-46c5-4ee5-bce1-fdcd973531cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:13.127124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:13.180391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1453/2865] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:13.189888 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:13.191584 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:13.252650 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b73b-e514-4e10-86df-ef2b211e56aa admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:13.256265 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:13.256915 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:13.257230 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:13.257511 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:13.267459 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:13.268896 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:13.279111 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1413/2866] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:13.905598 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a927-0547-45ea-be9e-1958174fd665 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:13.906166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a927-0547-45ea-be9e-1958174fd665 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:13.906166 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a927-0547-45ea-be9e-1958174fd665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:13.933333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-9409a927-0547-45ea-be9e-1958174fd665 None None] MFA Rules not processed for user `be644b899ffe419485aac64510542000`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:13.934590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-9409a927-0547-45ea-be9e-1958174fd665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:14.002052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1454/2867] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:14.014224 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:14.015697 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:14.074824 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f732fa-80d9-49bc-8ccc-b29ab5c275a3 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:14.078462 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:14.079145 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:14.079430 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:14.079707 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:14.088601 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:14.090088 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:14.099787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1414/2868] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:15.441095 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:15.441624 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:15.441724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:15.458925 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] MFA Rules not processed for user `be644b899ffe419485aac64510542000`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:47:15.460123 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:15.467181 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1455/2869] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:47:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:47:24.097085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:25.453564 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=56 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:36.764822 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:36.776883 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d0de7-5400-4f41-9d3f-35b26329c8d6 service cinder] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:36.780529 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:36.781816 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:36.782066 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:36.782347 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:36.784169 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:36.794943 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:36.796366 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1ef8f-82d7-485b-8537-6f6207bcee21 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:36.805618 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1415/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:36.881773 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:47:36.884274 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:36.896757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c5ef9-a7ac-49f9-8be0-d66a86ac9f68 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:47:36.900220 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:47:36.900849 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:47:36.901130 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:47:36.901430 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:47:36.903156 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:47:36.985403 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:47:36.986831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:47:37.006459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1456/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:47:46.802471 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:47:47.003960 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=43 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:17.434726 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:48:17.435269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:48:17.435269 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:48:17.453031 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] MFA Rules not processed for user `be644b899ffe419485aac64510542000`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:48:17.454480 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:48:17.461447 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1416/2872] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:48:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:48:27.448271 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:46.222229 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:48:46.223633 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:48:46.236299 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a991-9928-4bcc-9a13-58df1e20e2e0 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:48:46.239978 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:48:46.240623 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:48:46.240915 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:48:46.241211 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:48:46.242937 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:48:46.256366 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:48:46.257822 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:48:46.269025 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1457/2873] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:48:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:48:48.846738 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:48:48.856535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861f7dd-d491-4776-85e0-37bdc906bc06 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:48:48.860907 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:48:48.861692 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:48:48.862085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:48:48.862372 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:48:48.864524 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:48:48.880433 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:48:48.881899 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:48:48.893895 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1417/2874] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:48:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:48:56.263832 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=6 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:48:58.888032 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=6 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:06.072487 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:06.082330 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8bd5-68d0-45af-ba60-c321a0ed766c service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:06.086074 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:06.086764 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:06.087000 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:06.087276 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:06.089006 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:06.101337 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:06.102808 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:06.114031 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1458/2875] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:49:10.261048 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:10.275821 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4a3d-268b-49ff-9825-a87ae481d38e service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:10.281280 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:10.282681 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:10.283752 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:10.284260 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:10.286951 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:10.300779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:10.305405 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:10.324876 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1418/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:49:13.575091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:13.576992 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:13.639590 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:13.641680 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:13.655754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9182a-e996-46d5-b7fd-f5a554e43bc1 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:13.660452 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721cfa-7737-41ab-8998-b08d55e18fcd service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:13.661259 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:13.661928 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:13.662391 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:13.662676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:13.664678 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:13.666422 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:13.667333 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:13.667787 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:13.668226 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] PATH_INFO: `/v3/users/26738ea4f6d54d7d81f1ec5057c237ff` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:13.669564 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=26738ea4f6d54d7d81f1ec5057c237ff)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:13.671505 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:13.677909 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:13.679673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:13.693140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1459/2877] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 23:49:13.742987 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26738ea4f6d54d7d81f1ec5057c237ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:13.752448 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26738ea4f6d54d7d81f1ec5057c237ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:13.761695 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26738ea4f6d54d7d81f1ec5057c237ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:13.778958 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26738ea4f6d54d7d81f1ec5057c237ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:13.782139 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26738ea4f6d54d7d81f1ec5057c237ff'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:13.790025 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1419/2878] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:13 2022] DELETE /identity/v3/users/26738ea4f6d54d7d81f1ec5057c237ff => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:13.990743 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:14.002251 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c9e19-22ea-4f53-9cfe-8cdb13d1c97f service placement] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:14.059327 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:14.060194 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:14.060469 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:14.060740 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] PATH_INFO: `/v3/projects/44fb74dd337c49a898397e3482e4305d` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:14.061965 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fb74dd337c49a898397e3482e4305d)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:14.064482 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:14.117459 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fb74dd337c49a898397e3482e4305d', 'request_id': 'req-60dcd63d-8d09-4f1f-b05d-352317e5df81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.123620 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fb74dd337c49a898397e3482e4305d', 'request_id': 'req-60dcd63d-8d09-4f1f-b05d-352317e5df81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.130448 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fb74dd337c49a898397e3482e4305d', 'request_id': 'req-60dcd63d-8d09-4f1f-b05d-352317e5df81'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.144373 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] The token cache is being invalidate because project 44fb74dd337c49a898397e3482e4305d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:14.144761 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.145606 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.151660 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1460/2879] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:13 2022] DELETE /identity/v3/projects/44fb74dd337c49a898397e3482e4305d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:14.152513 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:14.154004 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:14.168500 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94daf05-6aab-49ac-98b6-9d851f5768ad admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:14.229764 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:14.230643 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:14.230928 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:14.231204 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] PATH_INFO: `/v3/users/0f4524b4093046efa0f3d5fb0ecc0b22` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:14.232912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4524b4093046efa0f3d5fb0ecc0b22)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:14.234669 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:14.283152 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4524b4093046efa0f3d5fb0ecc0b22'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.294956 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4524b4093046efa0f3d5fb0ecc0b22'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.301581 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:14.303647 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4524b4093046efa0f3d5fb0ecc0b22'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.319140 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4524b4093046efa0f3d5fb0ecc0b22'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.319868 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4524b4093046efa0f3d5fb0ecc0b22'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.326740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1420/2880] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:14 2022] DELETE /identity/v3/users/0f4524b4093046efa0f3d5fb0ecc0b22 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:49:14.533806 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:14.535852 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:14.549333 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcd63d-8d09-4f1f-b05d-352317e5df81 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:14.554056 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:14.617757 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:14.618637 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:14.618921 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:14.619195 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] PATH_INFO: `/v3/projects/e11d5ed75eca4fdb9b03bcce98078397` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:14.620387 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11d5ed75eca4fdb9b03bcce98078397)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:14.622361 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:14.670947 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11d5ed75eca4fdb9b03bcce98078397', 'request_id': 'req-ea1079f7-3437-49d4-b25d-d3a6e4c09467'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.676405 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11d5ed75eca4fdb9b03bcce98078397', 'request_id': 'req-ea1079f7-3437-49d4-b25d-d3a6e4c09467'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.682767 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11d5ed75eca4fdb9b03bcce98078397', 'request_id': 'req-ea1079f7-3437-49d4-b25d-d3a6e4c09467'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.698719 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] The token cache is being invalidate because project e11d5ed75eca4fdb9b03bcce98078397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:14.699036 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.699654 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:14.701695 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1461/2881] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:14 2022] DELETE /identity/v3/projects/e11d5ed75eca4fdb9b03bcce98078397 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:16.756266 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:16.757967 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:16.777065 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cca3d-4629-4a3d-8b07-2510b12cdf45 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:16.838795 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:16.839678 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:16.839963 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:16.840243 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] PATH_INFO: `/v3/users/be644b899ffe419485aac64510542000` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:16.841479 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be644b899ffe419485aac64510542000)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:16.843390 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:16.897381 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be644b899ffe419485aac64510542000'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:16.908072 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be644b899ffe419485aac64510542000'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:16.918070 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be644b899ffe419485aac64510542000'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:16.930948 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be644b899ffe419485aac64510542000'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:16.931804 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-58ba06d7-ae7c-43c8-b4b5-8264f47e171f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be644b899ffe419485aac64510542000'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:16.938565 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1421/2882] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:16 2022] DELETE /identity/v3/users/be644b899ffe419485aac64510542000 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:49:17.141861 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.144728 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:17.172140 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1079f7-3437-49d4-b25d-d3a6e4c09467 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.257444 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.258407 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.258754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.259207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] PATH_INFO: `/v3/projects/1f9a96f2aec2463e9cab476cb103b93a` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.260587 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9a96f2aec2463e9cab476cb103b93a)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.262527 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.309094 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:17.319098 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9a96f2aec2463e9cab476cb103b93a', 'request_id': 'req-87d8457d-6463-4a1a-8cb3-0166d180cbe3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:17.325760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9a96f2aec2463e9cab476cb103b93a', 'request_id': 'req-87d8457d-6463-4a1a-8cb3-0166d180cbe3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:17.332860 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9a96f2aec2463e9cab476cb103b93a', 'request_id': 'req-87d8457d-6463-4a1a-8cb3-0166d180cbe3'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:17.348818 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] The token cache is being invalidate because project 1f9a96f2aec2463e9cab476cb103b93a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80238) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:17.349241 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:17.349940 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-87d8457d-6463-4a1a-8cb3-0166d180cbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:17.351537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1462/2883] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:17 2022] DELETE /identity/v3/projects/1f9a96f2aec2463e9cab476cb103b93a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:17.356546 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.356912 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.357338 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.376676 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:49:17.377990 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:17.430957 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:17.444201 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1422/2884] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:49:17.451816 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.452129 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.452461 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.471574 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.auth.core [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80238) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:49:17.472812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:17.480781 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1463/2885] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:49:17.486514 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.499023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd68b7f-36c4-41b5-96ba-8d7b4ee991b3 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.509620 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.510393 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.510762 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.511093 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.512049 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80239) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 23:49:17.512311 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.517568 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.545660 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1423/2886] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 23:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 23:49:17.549729 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.570592 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6dc39-5405-4e6e-a32d-b5dd915d87f0 None None] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.576679 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.577673 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] REQUEST_METHOD: `POST` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.578155 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.578760 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.579748 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.583116 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.633676 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1464/2887] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 23:49:17 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 23:49:17.634501 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.646251 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeef24-5c15-4e94-87a3-f5c6e050b5e5 admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.718402 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.719165 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.719995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.719995 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.720531 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.722689 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.744363 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1424/2888] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 23:49:17 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 23:49:17.748754 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.761549 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c61ad-f739-4ef7-9e56-a98303de6397 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.767439 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.768128 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.768411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.768686 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.769534 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.771100 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.781465 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1465/2889] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 23:49:17.785521 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.795865 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07739ae7-dd26-445e-9056-9d92d29df6bc admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.802343 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.803024 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.803487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.803946 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.804693 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.806314 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74137e64-d1eb-4628-969e-3d059aaa9f09 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.821848 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1425/2890] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 23:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 23:49:17.823302 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:17.838236 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225276f4-0536-4816-9454-1cf5aea1de31 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:17.843922 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:17.845495 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] REQUEST_METHOD: `PUT` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.845779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.846052 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] PATH_INFO: `/v3/projects/ee60968397b8419c9882c9181228e8d1/users/4d492e2d55164896b1265aefa29f2719/roles/7df455d940c54f13b78a737b9c240982` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.864239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee60968397b8419c9882c9181228e8d1, user_id=4d492e2d55164896b1265aefa29f2719, role_id=7df455d940c54f13b78a737b9c240982)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:17.868124 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:17.883939 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1466/2891] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 23:49:17 2022] PUT /identity/v3/projects/ee60968397b8419c9882c9181228e8d1/users/4d492e2d55164896b1265aefa29f2719/roles/7df455d940c54f13b78a737b9c240982 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:17.895796 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:17.896284 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:17.896668 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:17.937602 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] MFA Rules not processed for user `4d492e2d55164896b1265aefa29f2719`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:49:17.939740 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:18.008556 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1426/2892] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:49:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:49:18.020707 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:18.022498 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:18.086305 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad681453-9bde-477a-af15-2e88596c910b admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:18.090125 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265bce5d41794e74833b744b83bd669a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:18.091078 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:18.091473 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:18.091724 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:18.101772 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:18.103235 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:18.114519 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1467/2893] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:49:19.998720 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:20.000190 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:20.059231 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d760-56a5-4b1f-9635-381e41e93c17 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:20.063297 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:20.064074 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] REQUEST_METHOD: `GET` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:20.064352 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:20.064623 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:20.066677 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:20.072832 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:20.132146 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:20.133649 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:20.145661 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1427/2894] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:49:21.245663 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:21.247160 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:21.263091 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3299f-9d7e-412f-b3ab-eaa19eec74e9 service cinder] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:21.267751 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:21.268609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:21.268894 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:21.269168 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] PATH_INFO: `/v3/users/974e560b80084538929507528d1ea9de` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:21.270411 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=974e560b80084538929507528d1ea9de)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:21.272320 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:21.318980 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974e560b80084538929507528d1ea9de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.322428 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:21.326260 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974e560b80084538929507528d1ea9de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.335346 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974e560b80084538929507528d1ea9de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.336019 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974e560b80084538929507528d1ea9de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.348343 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974e560b80084538929507528d1ea9de'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.354158 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1468/2895] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:21 2022] DELETE /identity/v3/users/974e560b80084538929507528d1ea9de => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 23:49:21.527778 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:21.540651 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9dfec-8049-480b-a73c-070d8b8b2636 service neutron] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:21.601771 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:21.602557 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:21.602836 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:21.603135 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] PATH_INFO: `/v3/projects/46779b270a484e19a7d9ede6406106d2` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:21.604291 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46779b270a484e19a7d9ede6406106d2)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:21.606221 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:21.656929 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46779b270a484e19a7d9ede6406106d2', 'request_id': 'req-aaadf11b-24c5-4ae6-b871-1593e157c36f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.663144 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46779b270a484e19a7d9ede6406106d2', 'request_id': 'req-aaadf11b-24c5-4ae6-b871-1593e157c36f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.670337 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46779b270a484e19a7d9ede6406106d2', 'request_id': 'req-aaadf11b-24c5-4ae6-b871-1593e157c36f'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.681293 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] The token cache is being invalidate because project 46779b270a484e19a7d9ede6406106d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:21.681582 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.682202 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.683758 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1428/2896] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:21 2022] DELETE /identity/v3/projects/46779b270a484e19a7d9ede6406106d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:21.688272 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:21.689890 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:21.704046 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb23cb-eca3-48c0-aa14-944e4f798e7a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:21.761370 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:21.762256 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:21.762537 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:21.762812 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] PATH_INFO: `/v3/users/0dc9cf6b59dc4133b7d48dcf405cba1c` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:21.764020 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc9cf6b59dc4133b7d48dcf405cba1c)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:21.766777 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:21.812207 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc9cf6b59dc4133b7d48dcf405cba1c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.819590 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc9cf6b59dc4133b7d48dcf405cba1c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.826609 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc9cf6b59dc4133b7d48dcf405cba1c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.827239 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc9cf6b59dc4133b7d48dcf405cba1c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.838982 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc9cf6b59dc4133b7d48dcf405cba1c'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:21.845179 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1469/2897] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:21 2022] DELETE /identity/v3/users/0dc9cf6b59dc4133b7d48dcf405cba1c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:22.020486 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:22.022046 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:22.038845 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadf11b-24c5-4ae6-b871-1593e157c36f admin admin] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:22.072085 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:22.100667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:22.101617 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:22.101902 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:22.102183 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] PATH_INFO: `/v3/projects/88b02f59005145a49a05978f60591123` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:22.103369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b02f59005145a49a05978f60591123)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:22.105330 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:22.153780 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b02f59005145a49a05978f60591123', 'request_id': 'req-8b67c0e4-db8b-492c-8d56-04471b38db15'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:22.159750 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b02f59005145a49a05978f60591123', 'request_id': 'req-8b67c0e4-db8b-492c-8d56-04471b38db15'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:22.166577 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b02f59005145a49a05978f60591123', 'request_id': 'req-8b67c0e4-db8b-492c-8d56-04471b38db15'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:22.177861 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] The token cache is being invalidate because project 88b02f59005145a49a05978f60591123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:22.178149 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:22.178770 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-8b67c0e4-db8b-492c-8d56-04471b38db15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:22.180306 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1429/2898] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:22 2022] DELETE /identity/v3/projects/88b02f59005145a49a05978f60591123 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:25.215176 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:25.216611 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:25.229882 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af46119-5403-40b8-b0ba-1797f0a35b19 admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:25.274627 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:25.288163 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:25.289034 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:25.289351 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:25.289622 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] PATH_INFO: `/v3/users/4d492e2d55164896b1265aefa29f2719` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:25.290809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d492e2d55164896b1265aefa29f2719)` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:25.292720 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:25.337831 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d492e2d55164896b1265aefa29f2719'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.346288 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d492e2d55164896b1265aefa29f2719'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.353243 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d492e2d55164896b1265aefa29f2719'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.353863 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d492e2d55164896b1265aefa29f2719'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.366995 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.notifications [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d492e2d55164896b1265aefa29f2719'} {{(pid=80238) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.372807 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1470/2899] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 23:49:25 2022] DELETE /identity/v3/users/4d492e2d55164896b1265aefa29f2719 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:25.377583 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] REQUEST_METHOD: `POST` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:25.378069 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:25.378181 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:25.395487 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.auth.core [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] MFA Rules not processed for user `055fbabca2a64bd6aab2d3bd73469ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80239) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 23:49:25.396667 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:25.455727 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1430/2900] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 23:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 23:49:25.465550 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:25.467077 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:25.526841 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b619329-24ab-4d0e-90a9-ee1f6902079a admin admin] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:25.530491 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '163fd72c29a54d5d977f0114cd9dab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:25.531143 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:25.531477 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:25.531929 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:25.541930 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:25.543368 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:25.554257 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1471/2901] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:49:25.821309 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] Authenticating user token {{(pid=80239) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:49:25.822779 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.fernet_utils [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80239) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:49:25.835688 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94011b-184a-4fed-83e0-3badbfd92862 None None] Validating token access rules against request {{(pid=80239) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:49:25.840691 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055fbabca2a64bd6aab2d3bd73469ee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853ebd43a36d473dbecd2e6330bf3136', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80239) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:49:25.842255 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:49:25.842891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:49:25.843185 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] PATH_INFO: `/v3/projects/ee60968397b8419c9882c9181228e8d1` {{(pid=80239) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:49:25.844599 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee60968397b8419c9882c9181228e8d1)` {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:49:25.846535 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] RBAC: Authorization granted {{(pid=80239) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:49:25.893055 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee60968397b8419c9882c9181228e8d1', 'request_id': 'req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.898638 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee60968397b8419c9882c9181228e8d1', 'request_id': 'req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.900598 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:25.907520 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee60968397b8419c9882c9181228e8d1', 'request_id': 'req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10'} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.921369 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] The token cache is being invalidate because project ee60968397b8419c9882c9181228e8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80239) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 23:49:25.921659 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.922344 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG keystone.notifications [None req-ba82a0cc-5cfd-4360-ad85-860dd5f18d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80239) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 23:49:25.923891 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: [pid: 80239|app: 0|req: 1431/2902] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 23:49:25 2022] DELETE /identity/v3/projects/ee60968397b8419c9882c9181228e8d1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 23:49:35.549810 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:49:35.918023 dv-cinder-850700-1-iscsi devstack@keystone.service[80239]: DEBUG dbcounter [-] [80239] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=4 {{(pid=80239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:51:46.179017 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] Authenticating user token {{(pid=80238) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 23:51:46.180442 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:51:46.252779 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b25-f063-48bd-aa4d-ebc88b4f8323 service neutron] Validating token access rules against request {{(pid=80238) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 23:51:46.312382 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a1a855f0a324f6b8a76bdbe18a04911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10357e8222ea424cab4e5c62a7b0087b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80238) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 23:51:46.313030 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] REQUEST_METHOD: `GET` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 23:51:46.313347 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 23:51:46.314151 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80238) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 23:51:46.316450 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.fernet_utils [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80238) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 23:51:46.327656 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 23:51:46.329809 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c04f3-2a49-49b2-9991-5bdd537a52a6 service placement] RBAC: Authorization granted {{(pid=80238) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 23:51:46.340389 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: [pid: 80238|app: 0|req: 1472/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 23:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 23:51:56.336072 dv-cinder-850700-1-iscsi devstack@keystone.service[80238]: DEBUG dbcounter [-] [80238] Writing DB stats keystone:SELECT=58 {{(pid=80238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}